etseidl commented on PR #11031: URL: https://github.com/apache/arrow-rs/pull/11031#issuecomment-5798552510
Uh oh. @adriangb I just remembered something. When we added the ParquetMetaDataWriter, I believe one use case was to externalize the footer metadata so it could be saved locally, while the original file lived elsewhere (in object store for instance). We _wanted_ to keep the page index locations intact so they could be fetched from the original file. But the changes we just made clear them now. I think that's a behavior change we want to think through. Perhaps add a boolean to the writer to optionally clear them? WDYT? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
