[jira] [Updated] (SPARK-48380) AutoBatchedPickler caused Unsafe allocate to fail due to 2GB limit

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48380: --- Labels: pull-request-available (was: ) > AutoBatchedPickler caused Unsafe allocate to fail

[jira] [Updated] (SPARK-48380) AutoBatchedPickler caused Unsafe allocate to fail due to 2GB limit

2024-05-21 Thread Zheng Shao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated SPARK-48380: --- Description: AutoBatchedPickler assumes that the row sizes are more or less uniform. That's of

[jira] [Updated] (SPARK-48380) AutoBatchedPickler caused Unsafe allocate to fail due to 2GB limit

2024-05-21 Thread Zheng Shao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated SPARK-48380: --- Description: AutoBatchedPickler assumes that the row sizes are more or less uniform. That's of

[jira] [Updated] (SPARK-48380) AutoBatchedPickler caused Unsafe allocate to fail due to 2GB limit

2024-05-21 Thread Zheng Shao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated SPARK-48380: --- Description: The stacktrace: {{```}} {{Py4JJavaError: An error occurred while calling

[jira] [Updated] (SPARK-48380) AutoBatchedPickler caused Unsafe allocate to fail due to 2GB limit

2024-05-21 Thread Zheng Shao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated SPARK-48380: --- Description: The stacktrace: {{```}} {{Py4JJavaError: An error occurred while calling