vburenin commented on pull request #2440: URL: https://github.com/apache/hudi/pull/2440#issuecomment-759766940
@vinothchandar I suspect the buffering of underlaying reads is on FileSystem driver, isn't it? If it is, GCS clearly not buffering it that can be seen in a form of a significant time distance (80 ms) between the calls to the readyFully method. ``` 404120 [Executor task launch worker for task 268] INFO org.apache.hudi.common.table.log.HoodieLogFileReader - Current magic position: 263 404183 [Executor task launch worker for task 268] INFO org.apache.hudi.common.table.log.HoodieLogFileReader - Current magic position: 264 404246 [Executor task launch worker for task 268] INFO org.apache.hudi.common.table.log.HoodieLogFileReader - Current magic position: 265 ``` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
