cloud-fan commented on PR #51182: URL: https://github.com/apache/spark/pull/51182#issuecomment-2982186085
> The inlining of Hadoop's LineRecordReader would be needed regardless of ZSTD support because of a follow-up change that I am working on, which would add allow users to specify compression type using file data source option. @pan3793 does Hadoop's `LineRecordReader` allow us to specify the compression at the session level without forking the code? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
