joshelser commented on pull request #3675: URL: https://github.com/apache/hbase/pull/3675#issuecomment-918552674
> By default, we will switch to stream after reading a small amount of data, several hundreds of KBs? If we read several hundreds of MBs of data in a map reduce job, I do not think it will effect the performance too much? For a standalone Java program reading a ~5G file in a single JVM, this change improved run time from 90s to 30s. In a distributed system, it only had about 15% improvement (network became the bottleneck -- that's where HBASE-26274 came into play). > [nit] if possible, can you fix the checkstyle and whitespace ? You bet. I hadn't looked at that yet. Thanks for calling it out! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
