[
https://issues.apache.org/jira/browse/SPARK-22692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16278392#comment-16278392
]
Sean Owen commented on SPARK-22692:
-----------------------------------
The sub JIRAs are pretty noisy. Are these really different, or so big they need
to be dealt with separately?
> Reduce the number of generated mutable states
> ---------------------------------------------
>
> Key: SPARK-22692
> URL: https://issues.apache.org/jira/browse/SPARK-22692
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.3.0
> Reporter: Marco Gaido
>
> A large number of mutable states can cause a error during code generation due
> to reaching the constant pool limit. There is an ongoing effort on
> SPARK-18016 to fix the problem, nonetheless we can also alleviate it avoiding
> to create a global variables when they are not needed.
> Therefore I am creating this umbrella ticket to track the elimination of
> usage of global variables where not needed. This is not a duplicate or an
> alternative to SPARK-18016: this is a complementary effort which can help
> together with it to support wider datasets.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
