Re: [I] [BUG] S3 Deltastreamer: Block has already been inflated [hudi]

2024-02-05 Thread via GitHub
chestnutqiang commented on issue #6428: URL: https://github.com/apache/hudi/issues/6428#issuecomment-1928891833 same problems, version 0.14.1, on hdfs . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [I] [BUG] S3 Deltastreamer: Block has already been inflated [hudi]

2023-10-09 Thread via GitHub
envomp commented on issue #6428: URL: https://github.com/apache/hudi/issues/6428#issuecomment-1752836684 Hey @ad1happy2go We have the following s3a configurations: ``` spark.hadoop.fs.s3a.path.style.access: true spark.hadoop.fs.s3a.threads.max: 64

Re: [I] [BUG] S3 Deltastreamer: Block has already been inflated [hudi]

2023-10-09 Thread via GitHub
ad1happy2go commented on issue #6428: URL: https://github.com/apache/hudi/issues/6428#issuecomment-1752649988 @envomp Are you setting `fs.s3a.connection.maximum` to a higher value. That might fix the Connection timeout issue. -- This is an automated message from the Apache Git Service.

Re: [I] [BUG] S3 Deltastreamer: Block has already been inflated [hudi]

2023-10-09 Thread via GitHub
envomp commented on issue #6428: URL: https://github.com/apache/hudi/issues/6428#issuecomment-1752559828 Hey folks, This issue: https://gist.github.com/envomp/268bdd35a3b3399db59583c0e159c229#file-cover-logs Seems to be a cover-up to real underlying issue which in our case