joaohmalves commented on PR #38873: URL: https://github.com/apache/beam/pull/38873#issuecomment-5327576322
Hi @chamikaramj, thanks for taking the time to go through the PR and for all the detailed feedback. I acknowledge the concerns you raised around the filesystem abstraction, error handling, range reads, and performance at scale. I’ll go through each of these points and make the necessary changes. I’ll also run the 100GB performance test comparing the Beam FileSystem handler with the default implementation and share the results. Thanks again for the review and for pointing out these areas. I’ll work on the improvements ASAP. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
