slfan1989 opened a new issue, #965:
URL: https://github.com/apache/hudi-rs/issues/965
### Is there an existing issue for this?
- [x] I have searched the existing issues
### Description of the bug
TimestampBasedKeyGenerator converts != and NOT IN filters into negative
partition-path filters. Since multiple timestamps share one partition, this can
exclude partitions containing matching rows.
### Steps To Reproduce
> Configure a timestamp-based table:
- hoodie.table.partition.fields=ts
- hoodie.keygen.timebased.timestamp.type=UNIX_TIMESTAMP
- hoodie.keygen.timebased.output.dateformat=yyyy/MM/dd
> Use partition 2024/01/25 containing:
- ts=1706140800 (midnight UTC)
- ts=1706184000 (noon UTC)
> Apply ts != 1706140800 or ts NOT IN (1706140800).
PartitionPruner::should_include("2024/01/25") returns false, although the
noon row matches.
### Expected behavior
Keep the partition and evaluate the negative predicate against individual
rows. The noon row should be returned.
### Screenshots / Logs
_No response_
### Software information
- Operating system: macOS 26.6.2, arm64
- Rust version: 1.94.1
- Project version: 0.7.0-dev
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
