idan57570-art commented on issue #2432: URL: https://github.com/apache/iceberg-rust/issues/2432#issuecomment-4424478878
"I’ve analyzed the issue regarding nested-leaf predicates in the Arrow reader. While there is a PR linked (#2433), it's crucial that we ensure the PredicateConverter doesn't just resolve the field ID but also correctly handles the ProjectionMask for nested Parquet structures. My proposed addition to the fix: We should implement a recursive check in bound_reference that validates the leaf type against the Arrow schema, even when the Parquet root is a group. This will prevent the row-filter from failing when it encounters struct-wrapped primitives. I can assist in verifying the fix with additional unit tests for multi-level nested structs if needed. Wallet: RTC972526299366 @Scottcjn" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
