[
https://issues.apache.org/jira/browse/SPARK-33576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248064#comment-17248064
]
Bryan Cutler commented on SPARK-33576:
--
[~darshats] I believe the only current workaround is to
[
https://issues.apache.org/jira/browse/SPARK-33576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242493#comment-17242493
]
Darshat commented on SPARK-33576:
-
Thanks [~bryanc] , yes this does look similar if not the same issue.
[
https://issues.apache.org/jira/browse/SPARK-33576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241769#comment-17241769
]
Bryan Cutler commented on SPARK-33576:
--
Is this due to the 2GB limit? As in
[
https://issues.apache.org/jira/browse/SPARK-33576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241683#comment-17241683
]
Darshat commented on SPARK-33576:
-
I set the following options to see if they'd help, but still get the
[
https://issues.apache.org/jira/browse/SPARK-33576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241342#comment-17241342
]
Darshat commented on SPARK-33576:
-
I turned on the jvm exception logging, and this is the full trace:
[
https://issues.apache.org/jira/browse/SPARK-33576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240896#comment-17240896
]
Darshat commented on SPARK-33576:
-
Hi Hyukjin,
Thanks for your reply.
I cannot repro on a smaller
[
https://issues.apache.org/jira/browse/SPARK-33576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240451#comment-17240451
]
Hyukjin Kwon commented on SPARK-33576:
--
- Are you able to provide the full reproducer with smaller
