BalaMahesh commented on issue #2230: URL: https://github.com/apache/hudi/issues/2230#issuecomment-723052237
Update : 1 I am able to by pass this issue by upgrading hadoop-aws-x.x.x.jar to 2.8.0 along with other dependencies in spark stand alone mode's jars. The logic of seek(pos) in the version 2.8.o is different from the 2.7.3. But my next doubt is , while querying the _rt table also HoodieLogReader comes into the picture if I am not wrong . If the cluster is running on hadoop < 2.8.0 then this will become the problem to query _rt tables unless the entire cluster is upgraded. Correct me if I am wrong. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
