hust-hhb commented on PR #28625: URL: https://github.com/apache/doris/pull/28625#issuecomment-1863799548
> Hi, you said “when string column insert length is too large which is over 4GB”， is this "4GB" referring to a column of a single row? @hust-hhb not a single row, your error message show that, there is a column is string type, when reading total rows at 3642, all the content of these column is over 4G, now doris can not process over 4G string. And now the totoal rows compaction want to read is decided by RuntimeState::DEFAULT_BATCH_SIZE, which is 4062 and can not change it by config now. I will make it configurable later, you can set it on a smaller number to solve your problem. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
