alamb commented on issue #4328: URL: https://github.com/apache/arrow-rs/issues/4328#issuecomment-2102427603
In any event I think the discussion on this ticket so far has been helpful. I was purposely trying to avoid a general purpose "correctly interpret all the possible statistics in parquet" type ticket for precisely the reasons @tustvold mentions about the scope being unclear If we wait for a complete well understood API I fear it is such a big barrier we will never start. I personally believe the functionality spelled out on this ticket (for which we have an existing example of use) would be beneficial to create. However, that being said, maybe it would be better to start by implementing it in DataFusion where the usecase is clear and we don't have to commit to a long term API, and once it looks good we can decide if we should port it upstream -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
