zhannngchen opened a new issue #8767: URL: https://github.com/apache/incubator-doris/issues/8767
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Description Flink connector write 5000 records per batch per second, it works well on 0.15, but it's easily to encounter -235 error on 1.0.0-rc2. We found that the cumulative compaction on 1.0.0-rc2 usually stall for 10 mins, which accumulates a lot of version. ``` be.INFO.log.20220330-182559:I0330 18:27:24.339799 22134 compaction.cpp:84] start cumulative compaction. tablet=13031.730663653.8f44e04102439930-575afe995c7f15bb, output_version=[2-565], permits: 7 be.INFO.log.20220330-182559:I0330 18:27:32.929353 22137 compaction.cpp:84] start cumulative compaction. tablet=13029.730663653.b94ab66c8122c4b9-31386d10a527a3b9, output_version=[2-569], permits: 5 be.INFO.log.20220330-182559:I0330 18:27:33.855492 22132 compaction.cpp:84] start cumulative compaction. tablet=13031.730663653.8f44e04102439930-575afe995c7f15bb, output_version=[2-569], permits: 5 be.INFO.log.20220330-183533:I0330 18:38:13.557895 22134 compaction.cpp:84] start cumulative compaction. tablet=13076.730663653.72452a3e914ef364-6bf121fedefa4d9b, output_version=[2-501], permits: 500 be.INFO.log.20220330-183533:I0330 18:38:13.568496 22132 compaction.cpp:84] start cumulative compaction. tablet=13074.730663653.364146b3ffb70a55-3f4194492ce02381, output_version=[2-501], permits: 500 ``` ### Solution In the PR https://github.com/apache/incubator-doris/pull/8072, @morningman fixed a bug. Before that patch, the config `min_compaction_failure_interval_sec` dose not work for cumulative compaction. In 1.0.0-rc2, this config may cause the cumulative compaction stalls for 10 minutes, it's too long for high frequency write scenario, we should change it to a smaller value. ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
