chengyfbj opened a new issue, #158: URL: https://github.com/apache/doris-flink-connector/issues/158
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Description In version 1.4.0，Release Note 1.4.0 shows： 6. Version 1.4.0 introduces a polling mechanism, and BE nodes are replaced during each Checkpoint, avoiding the pressure of a single node acting as a Coordinator for a long time. The Improvement is friendly to one stream load task. but In a high concurrency scenario, the load task is distributed to a BE node, resulting in great pressure on this node. my environment 72 parallelism, 3 FE node, 6 BE node, one BE node as 72 Coordinator is too heavy just some time after startup。traffic needs to be distributed to all BE nodes in a near-average. ### Solution In DorisWriter.initializeLoad() 107 line. //cache backend this.backends = RestService.getBackendsV2(dorisOptions, dorisReadOptions, LOG); Collections.shuffle(backends); //Is it possible to add this line ？ String backend = getAvailableBackend(); ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
