PliskinZhang commented on issue #24889: URL: https://github.com/apache/doris/issues/24889#issuecomment-1736549150
> > Hi, I would like to confirm if you are using routine load multi-table import, if you have a small number of jobs this may be another issue. If you have a large number the routine load jobs, you can: > > > > 1. Reduce concurrency by lowering max_routine_load_task_concurrent_num (fe.config) > > 2. Increase slots by increasing max_routine_load_task_num_per_be & routine_load_thread_pool_size. (be.config) > > > > And it should be noted that max_routine_load_task_num_per_be must be less than routine_load_thread_pool_size. > > Yes, I also use multi-table import, and under this occasion Increase slots can work for a while. After setting be multi_table_batch_plan_threshold=5 in be.conf，it is ok. But I still dont know why... it looks like worked.thanks. Perhaps due to insufficient data volume, the task backlog resulted in non commit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
