[
https://issues.apache.org/jira/browse/FLINK-25491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniel Cheng updated FLINK-25491:
---------------------------------
Description:
When using Table API, if you are filtering using an IN filter with a lot of
values, e.g. {{$(colName).in(<many values>)}}, it will result in the error
{{Code of method "<init>(...)V" of class "BatchExecCal$3006" grows beyond 64
KB}}
The size of the init method mainly comes from the below method, which
initializes the hash set with all the values in the filter.
addReusableHashSet in CodeGeneratorContext.scala
[https://github.com/apache/flink/blob/master/flink-table/flink-table-planner/src/main/scala/org/apache/flink/table/planner/codegen/CodeGeneratorContext.scala#L409]
This affects older versions as well, with 1.14.2 being the latest version that
exhibits this issue.
was:
When using Table API, if you are filtering using an IN filter with a lot of
values, e.g. {{$(colName).in(<many values>)}}, it will result in the error
{{Code of method "<init>(...)V" of class "BatchExecCal$3006" grows beyond 64
KB}}
The size of the init method mainly comes from the below method, which
initializes the hash set with all the values in the filter.
[https://github.com/apache/flink/blob/master/flink-table/flink-table-planner/src/main/scala/org/apache/flink/table/planner/codegen/CodeGeneratorContext.scala#L409]
This affects older versions as well, with 1.14.2 being the latest version that
exhibits this issue.
> Code generation: init method exceeds 64 KB when there is a large IN filter
> with Table API
> -----------------------------------------------------------------------------------------
>
> Key: FLINK-25491
> URL: https://issues.apache.org/jira/browse/FLINK-25491
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / API
> Affects Versions: 1.14.2
> Reporter: Daniel Cheng
> Priority: Major
>
> When using Table API, if you are filtering using an IN filter with a lot of
> values, e.g. {{$(colName).in(<many values>)}}, it will result in the error
>
> {{Code of method "<init>(...)V" of class "BatchExecCal$3006" grows beyond 64
> KB}}
>
> The size of the init method mainly comes from the below method, which
> initializes the hash set with all the values in the filter.
> addReusableHashSet in CodeGeneratorContext.scala
> [https://github.com/apache/flink/blob/master/flink-table/flink-table-planner/src/main/scala/org/apache/flink/table/planner/codegen/CodeGeneratorContext.scala#L409]
>
> This affects older versions as well, with 1.14.2 being the latest version
> that exhibits this issue.
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
