GoGoWen opened a new issue #7292: URL: https://github.com/apache/incubator-doris/issues/7292
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Description when loading much data(the data quality is so bad that nothing can be loaded to doris) from hdfs with broker load, the memory usage for be will be very high during loading. sometimes, will cause be OOM. and the root cause the row data from file is store in the memory pool of row batch, if no data can be loaded, all data read from file will store in memory pool of row batch cause memory usage very high, even OOM. ### Solution _No response_ ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
