bvaradar commented on issue #2193: URL: https://github.com/apache/hudi/issues/2193#issuecomment-714801051
@spyzzz : I do see from the attached commit log that the input batch has only inserts. Do you expect this to be the case ? If so, you can use "INSERT" operation type which will skip the index lookup completely. Also, it looks like you are doing inline compaction, you can try enabling async compaction but if this is pure inserts only, you can simply use COW mode Regarding file size, I dont see small file handling kicking in : Can you explicity set "hoodie.parquet.small.file.limit=104857600" ? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
