pan3793 opened a new pull request, #3041: URL: https://github.com/apache/parquet-java/pull/3041
<!-- Thanks for opening a pull request! If you're new to Parquet-Java, information on how to contribute can be found here: https://parquet.apache.org/docs/contribution-guidelines/contributing Please open a GitHub issue for this pull request: https://github.com/apache/parquet-java/issues/new/choose and format pull request title as below: GH-${GITHUB_ISSUE_ID}: ${SUMMARY} or simply use the title below if it is a minor issue: MINOR: ${SUMMARY} --> ### Rationale for this change Fixes the data loss issue that reported in #3040 ### What changes are included in this PR? Ensure that `StreamBytesInput#writeInto(ByteBuffer buffer)` copies data fully, even if the underlying `InputStream` does not report available correctly. ### Are these changes tested? UTs are added, I also tested it with an internal production data loss case. ### Are there any user-facing changes? Yes, this fixes some data loss cases, and I acknowledge that the bug affects Spark 4.0.0 preview2 which ships Parquet 1.14.2. Closes #3040 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
