vburenin commented on pull request #2500: URL: https://github.com/apache/hudi/pull/2500#issuecomment-792798073
Wow, this is super long reply. I truly appreciate the details. I am going to do the following: I will apply this fix on my end today and will try two run it through both scenarios. As I mentioned I had two different behaviors, first one running it as a k8s spark app and the second one running it locally as a deltastreamer app. As of this moment I confirmed that I used two different GCS connectors, the latest version -1 was used locally and 2019 version was used on k8s. I think, the confusion is actually coming from GCS connector. One more separate thing, we may want to dig into later. I use the pre-latest GCS-connection library version due to some libraries conflict that prevents me from running Hudi at all, did you use the latest version by chance? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
