rubenssoto edited a comment on issue #2515: URL: https://github.com/apache/hudi/issues/2515#issuecomment-774520707
@vinothchandar and @n3nash I decide to do more tests and I realized that only when I had the option hoodie.datasource.write.row.writer.enable TRUE on the bulk insert I had the problem "Failed to archive commits". I tried to bootstrap my tables with that option false and the problem stopped. To be sure if is not an EMR problem I did some tests on my machine and I had the same issue. To reproduce: bootstrap a table using bulk_insert with option hoodie.datasource.write.row.writer.enable TRUE, do some upserts until the first archive attempt. I changed some default options to test faster: hoodie.keep.min.commits: String = "2", hoodie.keep.max.commits: String = "3", hoodie.cleaner.commits.retained: String = "1" Spark 3.0.1 Hudi Version 0.7.0  I tried in my machine with the patch, and had the same error. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
