trikker commented on issue #28868: URL: https://github.com/apache/doris/issues/28868#issuecomment-1892122121
> The order by operator is a blocking operator which means Doris need to load all of data (include all columns) in memory. 100KB * 150K rows = 15000000 kb => 15G The error message " process memory used 180.24 GB exceed limit 151.01 GB or sys available memory 38.30 GB less than low water mark 16.00 GB. " May be your process is running other query which already cost lots of memory. So could your please only run this query and confirm memory used by this query ? 100k-150k is the average rows in one partition(one day). The SQL queries the range of two months. Which is about 300GB per month. In MySQL, the table ibd file is about 4GB per partition. That is at least 120GB per month and 240GB of two months. 150GB is limited by setting "mem_limit = 30%" in be.conf. The server's memory is 512GB. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
