[jira] [Resolved] (SPARK-46337) Make `CTESubstitution` retain the PLAN_ID_TAG

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46337. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44268

[jira] [Assigned] (SPARK-46337) Make `CTESubstitution` retain the PLAN_ID_TAG

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46337: Assignee: Ruifeng Zheng > Make `CTESubstitution` retain the PLAN_ID_TAG >

[jira] [Assigned] (SPARK-46339) Directory with number name should not be treated as metadata log

2023-12-08 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-46339: --- Assignee: L. C. Hsieh > Directory with number name should not be treated as metadata log >

[jira] [Updated] (SPARK-46339) Directory with number name should not be treated as metadata log

2023-12-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46339: --- Labels: pull-request-available (was: ) > Directory with number name should not be treated

[jira] [Created] (SPARK-46339) Directory with number name should not be treated as metadata log

2023-12-08 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-46339: --- Summary: Directory with number name should not be treated as metadata log Key: SPARK-46339 URL: https://issues.apache.org/jira/browse/SPARK-46339 Project: Spark

[jira] [Updated] (SPARK-46338) Re-enable the get_item test for BasicIndexingTests

2023-12-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46338: --- Labels: pull-request-available (was: ) > Re-enable the get_item test for

[jira] [Created] (SPARK-46338) Re-enable the get_item test for BasicIndexingTests

2023-12-08 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46338: --- Summary: Re-enable the get_item test for BasicIndexingTests Key: SPARK-46338 URL: https://issues.apache.org/jira/browse/SPARK-46338 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46337) Make `CTESubstitution` retain the PLAN_ID_TAG

2023-12-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46337: --- Labels: pull-request-available (was: ) > Make `CTESubstitution` retain the PLAN_ID_TAG >

[jira] [Created] (SPARK-46337) Make `CTESubstitution` retain the PLAN_ID_TAG

2023-12-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46337: - Summary: Make `CTESubstitution` retain the PLAN_ID_TAG Key: SPARK-46337 URL: https://issues.apache.org/jira/browse/SPARK-46337 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46334) Update pandas to 2.1.4

2023-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46334. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44266

[jira] [Resolved] (SPARK-46335) Upgrade Maven to 3.9.6 for MNG-7913

2023-12-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46335. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44267

[jira] [Commented] (SPARK-46336) Cancel zombie tasks when a ShuffleMapStage is finished

2023-12-08 Thread Xingbo Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17794888#comment-17794888 ] Xingbo Jiang commented on SPARK-46336: -- I'm currently working on this. > Cancel zombie tasks when

[jira] [Created] (SPARK-46336) Cancel zombie tasks when a ShuffleMapStage is finished

2023-12-08 Thread Xingbo Jiang (Jira)
Xingbo Jiang created SPARK-46336: Summary: Cancel zombie tasks when a ShuffleMapStage is finished Key: SPARK-46336 URL: https://issues.apache.org/jira/browse/SPARK-46336 Project: Spark Issue

[jira] [Updated] (SPARK-42789) Rewrite multiple GetJsonObjects to a JsonTuple if their json expression is the same

2023-12-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42789: --- Labels: pull-request-available (was: ) > Rewrite multiple GetJsonObjects to a JsonTuple if

[jira] [Updated] (SPARK-44998) No need to retry parsing event log path again when FileNotFoundException occurs

2023-12-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44998: --- Labels: pull-request-available (was: ) > No need to retry parsing event log path again

[jira] [Updated] (SPARK-41006) ConfigMap has the same name when launching two pods on the same namespace

2023-12-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-41006: --- Labels: pull-request-available (was: ) > ConfigMap has the same name when launching two

[jira] [Updated] (SPARK-46335) Upgrade Maven to 3.9.6 for MNG-7913

2023-12-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46335: --- Labels: pull-request-available (was: ) > Upgrade Maven to 3.9.6 for MNG-7913 >

[jira] [Resolved] (SPARK-46325) Remove unnecessary override functions when constructing `WrappedCloseableIterator` in `ResponseValidator#wrapIterator`

2023-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46325. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44255

[jira] [Assigned] (SPARK-46325) Remove unnecessary override functions when constructing `WrappedCloseableIterator` in `ResponseValidator#wrapIterator`

2023-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46325: - Assignee: Yang Jie > Remove unnecessary override functions when constructing >

[jira] [Updated] (SPARK-46334) Update pandas to 2.1.4

2023-12-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46334: --- Labels: pull-request-available (was: ) > Update pandas to 2.1.4 > -- >

[jira] [Created] (SPARK-46334) Update pandas to 2.1.4

2023-12-08 Thread Jira
Bjørn Jørgensen created SPARK-46334: --- Summary: Update pandas to 2.1.4 Key: SPARK-46334 URL: https://issues.apache.org/jira/browse/SPARK-46334 Project: Spark Issue Type: Dependency upgrade

[jira] [Resolved] (SPARK-46332) Migrate CatalogNotFoundException to an error class

2023-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46332. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44259

[jira] [Resolved] (SPARK-46324) Fix the output name of pyspark.sql.functions.user and session_user

2023-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46324. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44253

[jira] [Assigned] (SPARK-46324) Fix the output name of pyspark.sql.functions.user and session_user

2023-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46324: - Assignee: Hyukjin Kwon > Fix the output name of pyspark.sql.functions.user and

[jira] [Resolved] (SPARK-46328) Allocate capacity of array list of TColumns by columns size in TRowSet generation

2023-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46328. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44258

[jira] [Assigned] (SPARK-46328) Allocate capacity of array list of TColumns by columns size in TRowSet generation

2023-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46328: - Assignee: Bowen Liang > Allocate capacity of array list of TColumns by columns size in

[jira] [Updated] (SPARK-46328) Allocate capacity of array list of TColumns by columns size in TRowSet generation

2023-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46328: -- Affects Version/s: 4.0.0 (was: 3.5.0) > Allocate capacity of array

[jira] [Updated] (SPARK-46332) Migrate CatalogNotFoundException to an error class

2023-12-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46332: --- Labels: pull-request-available (was: ) > Migrate CatalogNotFoundException to an error

[jira] [Updated] (SPARK-46132) [CORE] Support key password for JKS keys for RPC SSL

2023-12-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46132: --- Labels: pull-request-available (was: ) > [CORE] Support key password for JKS keys for RPC

[jira] [Updated] (SPARK-46289) Exception when ordering by UDT in interpreted mode

2023-12-08 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-46289: -- Priority: Minor (was: Major) > Exception when ordering by UDT in interpreted mode >

[jira] [Updated] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

2023-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45599: -- Priority: Critical (was: Blocker) > Percentile can produce a wrong answer if -0.0 and 0.0

[jira] [Updated] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

2023-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45599: -- Affects Version/s: 1.6.3 1.4.1 > Percentile can produce a wrong answer

[jira] [Commented] (SPARK-44900) Cached DataFrame keeps growing

2023-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17794817#comment-17794817 ] Dongjoon Hyun commented on SPARK-44900: --- Could you try this with Apache Spark 3.5.0, please? >

[jira] [Resolved] (SPARK-44772) Reading blocks from remote executors causes timeout issue

2023-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44772. --- Resolution: Cannot Reproduce > Reading blocks from remote executors causes timeout issue >

[jira] [Updated] (SPARK-44900) Cached DataFrame keeps growing

2023-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44900: -- Priority: Major (was: Blocker) > Cached DataFrame keeps growing >

[jira] [Created] (SPARK-46333) Replace IllegalStateException by SparkException.internalError in catalyst

2023-12-08 Thread Max Gekk (Jira)
Max Gekk created SPARK-46333: Summary: Replace IllegalStateException by SparkException.internalError in catalyst Key: SPARK-46333 URL: https://issues.apache.org/jira/browse/SPARK-46333 Project: Spark

[jira] [Commented] (SPARK-44772) Reading blocks from remote executors causes timeout issue

2023-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17794816#comment-17794816 ] Dongjoon Hyun commented on SPARK-44772: --- Could you try this with Apache Spark 3.5.0? > Reading

[jira] [Updated] (SPARK-44772) Reading blocks from remote executors causes timeout issue

2023-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44772: -- Priority: Major (was: Blocker) > Reading blocks from remote executors causes timeout issue

[jira] [Created] (SPARK-46332) Migrate CatalogNotFoundException to an error class

2023-12-08 Thread Max Gekk (Jira)
Max Gekk created SPARK-46332: Summary: Migrate CatalogNotFoundException to an error class Key: SPARK-46332 URL: https://issues.apache.org/jira/browse/SPARK-46332 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46331) Removing CodeGenFallback trait from subset of datetime and spark version functions

2023-12-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46331: --- Labels: pull-request-available (was: ) > Removing CodeGenFallback trait from subset of

[jira] [Resolved] (SPARK-46327) Reorganize `SeriesStringTests`

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46327. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44257

[jira] [Assigned] (SPARK-46327) Reorganize `SeriesStringTests`

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46327: Assignee: Ruifeng Zheng > Reorganize `SeriesStringTests` >

[jira] [Created] (SPARK-46331) Removing CodeGenFallback trait from subset of datetime and spark version functions

2023-12-08 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-46331: Summary: Removing CodeGenFallback trait from subset of datetime and spark version functions Key: SPARK-46331 URL: https://issues.apache.org/jira/browse/SPARK-46331

[jira] [Assigned] (SPARK-46326) Test missing cases for functions (pyspark.sql.functions)

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46326: Assignee: Hyukjin Kwon > Test missing cases for functions (pyspark.sql.functions) >

[jira] [Resolved] (SPARK-46326) Test missing cases for functions (pyspark.sql.functions)

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46326. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44256

[jira] [Updated] (SPARK-46330) Loading of Spark UI blocks for a long time when HybridStore enabled

2023-12-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46330: --- Labels: pull-request-available (was: ) > Loading of Spark UI blocks for a long time when

[jira] (SPARK-46330) Loading of Spark UI blocks for a long time when HybridStore enabled

2023-12-08 Thread Zhou Yifan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46330 ] Zhou Yifan deleted comment on SPARK-46330: was (Author: zhouyifan279): *HybridStore#close,* may took long if there was still a lot of data waiting to be written to disk when closing. I

[jira] [Updated] (SPARK-46330) Loading of Spark UI blocks for a long time when HybridStore enabled

2023-12-08 Thread Zhou Yifan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Yifan updated SPARK-46330: --- Description: In our SparkHistoryServer, we used these two property to speed up Spark UI's loading:

[jira] [Updated] (SPARK-39176) Pyspark failed to serialize dates before 1970 in windows

2023-12-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-39176: --- Labels: 3.0.1 PySpark WIndows datetime pull-request-available (was: 3.0.1 PySpark WIndows

[jira] [Assigned] (SPARK-46328) Allocate capacity of array list of TColumns by columns size in TRowSet generation

2023-12-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46328: -- Assignee: Apache Spark > Allocate capacity of array list of TColumns by columns size

[jira] [Assigned] (SPARK-46328) Allocate capacity of array list of TColumns by columns size in TRowSet generation

2023-12-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46328: -- Assignee: (was: Apache Spark) > Allocate capacity of array list of TColumns by

[jira] [Assigned] (SPARK-46328) Allocate capacity of array list of TColumns by columns size in TRowSet generation

2023-12-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46328: -- Assignee: (was: Apache Spark) > Allocate capacity of array list of TColumns by

[jira] [Assigned] (SPARK-46328) Allocate capacity of array list of TColumns by columns size in TRowSet generation

2023-12-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46328: -- Assignee: Apache Spark > Allocate capacity of array list of TColumns by columns size

[jira] [Commented] (SPARK-46330) Loading of Spark UI blocks for a long time when HybridStore enabled

2023-12-08 Thread Zhou Yifan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17794589#comment-17794589 ] Zhou Yifan commented on SPARK-46330: *HybridStore#close,* may took long if there was still a lot of

[jira] [Updated] (SPARK-46330) Loading of Spark UI blocks for a long time when HybridStore enabled

2023-12-08 Thread Zhou Yifan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Yifan updated SPARK-46330: --- Description: In our SparkHistoryServer, we used these two property to speed up Spark UI's loading:

[jira] [Updated] (SPARK-46328) Allocate capacity of array list of TColumns by columns size in TRowSet generation

2023-12-08 Thread Bowen Liang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bowen Liang updated SPARK-46328: Summary: Allocate capacity of array list of TColumns by columns size in TRowSet generation (was:

[jira] [Updated] (SPARK-46330) Loading of Spark UI blocks for a long time when HybridStore enabled

2023-12-08 Thread Zhou Yifan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Yifan updated SPARK-46330: --- Affects Version/s: 3.1.2 (was: 3.3.1) > Loading of Spark UI blocks for a

[jira] [Updated] (SPARK-46328) Allocate capacity by columns size for array list of TColumns in TRowSet generation

2023-12-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46328: --- Labels: pull-request-available (was: ) > Allocate capacity by columns size for array list

[jira] [Updated] (SPARK-46330) Loading of Spark UI blocks for a long time when HybridStore enabled

2023-12-08 Thread Zhou Yifan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Yifan updated SPARK-46330: --- Description: In our SparkHistoryServer, we used these two property to speed up Spark UI's loading:

[jira] [Created] (SPARK-46329) Spark UI's loading blocks for a long time when HybridStore enabled

2023-12-08 Thread Zhou Yifan (Jira)
Zhou Yifan created SPARK-46329: -- Summary: Spark UI's loading blocks for a long time when HybridStore enabled Key: SPARK-46329 URL: https://issues.apache.org/jira/browse/SPARK-46329 Project: Spark

[jira] [Created] (SPARK-46330) Spark UI's loading blocks for a long time when HybridStore enabled

2023-12-08 Thread Zhou Yifan (Jira)
Zhou Yifan created SPARK-46330: -- Summary: Spark UI's loading blocks for a long time when HybridStore enabled Key: SPARK-46330 URL: https://issues.apache.org/jira/browse/SPARK-46330 Project: Spark

[jira] [Updated] (SPARK-46330) Loading of Spark UI blocks for a long time when HybridStore enabled

2023-12-08 Thread Zhou Yifan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Yifan updated SPARK-46330: --- Summary: Loading of Spark UI blocks for a long time when HybridStore enabled (was: Spark UI's

[jira] [Updated] (SPARK-46328) Allocate capacity by columns size for array list of TColumns in TRowSet generation

2023-12-08 Thread Bowen Liang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bowen Liang updated SPARK-46328: Summary: Allocate capacity by columns size for array list of TColumns in TRowSet generation

[jira] [Created] (SPARK-46328) Allocate enough capacity for assembling array list of TColumns in TRowSet generation

2023-12-08 Thread Bowen Liang (Jira)
Bowen Liang created SPARK-46328: --- Summary: Allocate enough capacity for assembling array list of TColumns in TRowSet generation Key: SPARK-46328 URL: https://issues.apache.org/jira/browse/SPARK-46328

[jira] [Updated] (SPARK-46327) Reorganize `SeriesStringTests`

2023-12-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46327: --- Labels: pull-request-available (was: ) > Reorganize `SeriesStringTests` >

[jira] [Created] (SPARK-46327) Reorganize `SeriesStringTests`

2023-12-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46327: - Summary: Reorganize `SeriesStringTests` Key: SPARK-46327 URL: https://issues.apache.org/jira/browse/SPARK-46327 Project: Spark Issue Type: Test

[jira] [Assigned] (SPARK-46323) Fix the output name of pyspark.sql.functions.now

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46323: Assignee: Hyukjin Kwon > Fix the output name of pyspark.sql.functions.now >

[jira] [Resolved] (SPARK-46323) Fix the output name of pyspark.sql.functions.now

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46323. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44252