dossett opened a new pull request, #3783: URL: https://github.com/apache/parquet-java/pull/3783
Upgrade Hadoop from 3.3.0 to 3.3.5. This picks up accumulated filesystem and security fixes, and makes the existing vectored-I/O integration usable for local files and S3A.\n\nHadoop 3.3.5's ChecksumFileSystem allocates internal checksum buffers through the caller allocator, but returns slices of the data buffers. Track the original allocations and release them with the row group so enabling vectored reads does not leak buffers.\n\nTests:\n- ./mvnw --batch-mode -pl parquet-hadoop -am test\n- ./mvnw --batch-mode -pl parquet-hadoop -am -DskipTests verify\n- TestParquetFileReaderBufferLeak#testClosingVectoredReaderReleasesAllBuffers -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
