[
https://issues.apache.org/jira/browse/HIVE-30110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Denys Kuzmenko updated HIVE-30110:
----------------------------------
Description:
Trigger: orc.sarg.to.filter=true
ORC drops rows inside a batch that fail the pushed-down filter and packs the
remaining rows together. Batch row i is then no longer file row batchStart + i.
Everything that assumes it is then points at the wrong rows: position deletes,
ROW__POSITION and row lineage.
Turning off orc.filter.use.selected isn't enough; sarg.to.filter alone shifts
positions.
was:Trigger: orc.sarg.to.filter=true
> Iceberg: ORC filters rows inside a vectorized batch, misaligning row
> positions
> -------------------------------------------------------------------------------
>
> Key: HIVE-30110
> URL: https://issues.apache.org/jira/browse/HIVE-30110
> Project: Hive
> Issue Type: Bug
> Components: Iceberg integration
> Reporter: Denys Kuzmenko
> Priority: Major
>
> Trigger: orc.sarg.to.filter=true
> ORC drops rows inside a batch that fail the pushed-down filter and packs the
> remaining rows together. Batch row i is then no longer file row batchStart +
> i.
> Everything that assumes it is then points at the wrong rows: position
> deletes, ROW__POSITION and row lineage.
>
> Turning off orc.filter.use.selected isn't enough; sarg.to.filter alone shifts
> positions.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
