AnuragRaut08 commented on PR #51357:
URL: https://github.com/apache/arrow/pull/51357#issuecomment-5742702502
Hi @wgtmac ,
I’ve addressed this point in the latest push. The compact Arrow `null_count`
is now kept separate from the total Parquet null count: `null_count` is used by
`MaybeReplaceValidity`, while `total_null_count` includes repeated-ancestor
nulls and is used for `WriteValuesSpaced` and Parquet page/statistics metadata.
This keeps the Arrow validity semantics unchanged while fixing the Parquet
null count for null/empty repeated ancestors. Could you please take another
look when you get a chance? Thanks!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
