[
https://issues.apache.org/jira/browse/FLINK-32486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lijie Wang closed FLINK-32486.
------------------------------
Release Note:
We introduce runtime filter for batch jobs in 1.18, which is designed to
improve join performance. It will dynamically generate filter conditions for
certain Join queries at runtime to reduce the amount of scanned or shuffled
data, avoid unnecessary I/O and network transmission, and speed up the query.
Its working principle is building a filter(e.g. bloom filter) based on the data
on the small table side(build side) first, then pass this filter to the large
table side(probe side) to filter the irrelevant data on it, this can reduce the
data reaching the join and improve performance.
Resolution: Done
> FLIP-324: Introduce Runtime Filter for Flink Batch Jobs
> -------------------------------------------------------
>
> Key: FLINK-32486
> URL: https://issues.apache.org/jira/browse/FLINK-32486
> Project: Flink
> Issue Type: Improvement
> Components: Table SQL / Planner, Table SQL / Runtime
> Reporter: Lijie Wang
> Assignee: Lijie Wang
> Priority: Major
> Fix For: 1.18.0
>
>
> This is an umbrella ticket for
> [FLIP-324|https://cwiki.apache.org/confluence/display/FLINK/FLIP-324%3A+Introduce+Runtime+Filter+for+Flink+Batch+Jobs]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
