[
https://issues.apache.org/jira/browse/HIVE-26137?focusedWorklogId=759329&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-759329
]
ASF GitHub Bot logged work on HIVE-26137:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 20/Apr/22 15:46
Start Date: 20/Apr/22 15:46
Worklog Time Spent: 10m
Work Description: szlta merged PR #3203:
URL: https://github.com/apache/hive/pull/3203
Issue Time Tracking
-------------------
Worklog Id: (was: 759329)
Time Spent: 40m (was: 0.5h)
> Optimized transfer of Iceberg residual expressions from AM to execution
> -----------------------------------------------------------------------
>
> Key: HIVE-26137
> URL: https://issues.apache.org/jira/browse/HIVE-26137
> Project: Hive
> Issue Type: Improvement
> Reporter: Ádám Szita
> Assignee: Ádám Szita
> Priority: Major
> Labels: pull-request-available
> Time Spent: 40m
> Remaining Estimate: 0h
>
> HIVE-25967 introduced a hack to prevent Iceberg filter expressions to be
> serialized into splits. This temporary fix was to avoid OOM problems on Tez
> AM side, but at the same time prevented predicate pushdowns to work on the
> execution side too.
> This ticket intends to incorporate the long term solution. It turns out that
> the file scan tasks created by Iceberg actually don't contain a "residual"
> expressions, but rather a complete/original one. It becomes residual only
> when it is evaluated against the tasks' partition value, which only happens
> on the execution site. This means that the original filter is the same
> expression for all splits in Tez AM, so we can transfer it via job conf
> instead.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
