[
https://issues.apache.org/jira/browse/SPARK-31007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17489270#comment-17489270
]
zhengruifeng commented on SPARK-31007:
--
this case is not OOM, but the overflow:
{code:java}
[
https://issues.apache.org/jira/browse/SPARK-31007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17489235#comment-17489235
]
Sean R. Owen commented on SPARK-31007:
--
Hm, can you use a simpler "unpacked" representation for
[
https://issues.apache.org/jira/browse/SPARK-31007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17489230#comment-17489230
]
zhengruifeng commented on SPARK-31007:
--
[~srowen] This optimization needs an array of size
val
