steveloughran commented on issue #3356: URL: https://github.com/apache/parquet-java/issues/3356#issuecomment-4444412710
I actually do want to sit down with claude and get the fundamental issue fixed, which is ChecksumFileSystem.readVectored for 3.4.2+ you can actually turn off checksum validation here ``` fs.file.checksum.verify = false ``` see https://issues.apache.org/jira/browse/HADOOP-18296 This is tangibly faster for vector iO, as all requests should be mapped to jni scatter gather. There's no checksumming for any file:// reads, but if you trust your SSD you are safe, at least for unit tests. we do this for our tests -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
