steveloughran commented on PR #6904: URL: https://github.com/apache/hadoop/pull/6904#issuecomment-2213633311
Raising an java.io.EOFException when passing down an offset/range > file length is what is required, so all is good. s3a and abfs support the openFileWithOptions so they can save a HEAD request if they know the file length/file status of the file. I'd recommend implementing the interface because it can be used to speed up file opening. Adoption has been slow as apps still try to build with older hadoop releases, which is why #6686 is making it easier to use reflection to invoke them...I have a matching change in parquet which will take the known file status and save some IO. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
