xiaokang commented on pull request #8322: URL: https://github.com/apache/incubator-doris/pull/8322#issuecomment-1066228733
@xinyiZzz When I test for #8451 , I encounter a memory limit problem. The problem is that, after the long query, as specified in the test steps of #8451 , is finished, a simple query 'select count() from tableA' will raise memory limit error. I guess it's related to this pr, since the problem is not present before I merge the new MemTracker code. The following is mysql client error message. > ERROR 1105 (HY000): errCode = 2, detailMessage = Memory exceed limit. fragment=4f5f114582e7429d-a630eec6e0e45384, details=New partitioned aggregation, while getting next from child 0., on backend=[172.16.44.107](http://172.16.44.107/). Memory left in process limit=8589934592.00 GB. current tracker <label=RuntimeState:inst The following is some related logs of be. > I0312 10:58:07.931836 2320 plan_fragment_executor.cpp:76] PlanFragmentExecutor::prepare|pthread_id=140354754955008|backend_num=1|instance_id=35895a325c6943dc -872eced6dfcb8c91|query_id=35895a325c6943dc-872eced6dfcb8c90 I0312 10:58:07.936765 2203 fragment_mgr.cpp:459] PlanFragmentExecutor::_exec_actual|pthread_id=140355728508672|instance_id=35895a325c6943dc-872eced6dfcb8c91| query_id=35895a325c6943dc-872eced6dfcb8c90 I0312 10:58:07.936780 2203 plan_fragment_executor.cpp:213] PlanFragmentExecutor::open, using query memory limit: 7.59 GB|mem_limit=8147483648|instance_id=358 95a325c6943dc-872eced6dfcb8c91|query_id=35895a325c6943dc-872eced6dfcb8c90 W0312 10:58:07.936826 2203 status.h:260] warning: Status msg truncated, OK: Memory exceed limit. fragment=35895a325c6943dc-872eced6dfcb8c91, details=New part itioned aggregation, while getting next from child 0., on backend=[172.16.44.107](http://172.16.44.107/). Memory left in process limit=8589934592.00 GB. current tracker <label=Runtime State:instance:35895a325c6943dc-872eced6dfcb8c91, used=18432, limit=8147483648, failed alloc size=-1.00 B>. If query, can change the limit by session variable exec_mem_limit. precise_code:1 W0312 10:58:07.943392 2203 mem_tracker.cpp:290] Memory exceed limit. fragment=35895a325c6943dc-872eced6dfcb8c91, details=New partitioned aggregation, while g etting next from child 0., on backend=[172.16.44.107](http://172.16.44.107/). Memory left in process limit=8589934592.00 GB. current tracker <label=RuntimeState:instance:35895a325c694 3dc-872eced6dfcb8c91, used=18432, limit=8147483648, failed alloc size=-1.00 B>. If query, can change the limit by session variable exec_mem_limit. MemTracker log_usage Label: queryId=35895a325c6943dc-872eced6dfcb8c90, Limit: 7.59 GB, Total: 19.00 KB, Peak: 19.00 KB, Exceeded: false MemTracker log_usage Label: RuntimeState:instance:35895a325c6943dc-872eced6dfcb8c92, Limit: 7.59 GB, Total: 1.00 KB, Peak: 1.00 KB, Exceeded: false MemTracker log_usage Label: RuntimeFilterMgr, Limit: -1.00 B, Total: 0, Peak: 0, Exceeded: false MemTracker log_usage Label: RuntimeState:instance:35895a325c6943dc-872eced6dfcb8c91, Limit: 7.59 GB, Total: 18.00 KB, Peak: 18.00 KB, Exceeded: false MemTracker log_usage Label: RuntimeFilterMgr, Limit: -1.00 B, Total: 0, Peak: 0, Exceeded: false MemTracker log_usage Label: ExecNode:AGGREGATION_NODE (id=1), Limit: -1.00 B, Total: 1.00 KB, Peak: 1.00 KB, Exceeded: false MemTracker log_usage Label: DataStreamSender:35895a325c6943dc-872eced6dfcb8c91, Limit: -1.00 B, Total: 16.00 KB, Peak: 16.00 KB, Exceeded: false W0312 10:58:07.944548 2203 fragment_mgr.cpp:231] Got error while opening fragment 35895a325c6943dc-872eced6dfcb8c91: Memory limit exceeded: Memory exceed lim it. fragment=35895a325c6943dc-872eced6dfcb8c91, details=New partitioned aggregation, while getting next from child 0., on backend=[172.16.44.107](http://172.16.44.107/). Memory left i n process limit=8589934592.00 GB. current tracker <label=RuntimeState:inst I0312 10:58:07.944562 2316 internal_service.cpp:187] cancel fragment, fragment_instance_id=35895a325c6943dc-872eced6dfcb8c92, reason: 3 I0312 10:58:07.944604 2316 plan_fragment_executor.cpp:602] PlanFragmentExecutor::cancel|instance_id=35895a325c6943dc-872eced6dfcb8c92|query_id=35895a325c6943 dc-872eced6dfcb8c90 W0312 10:58:07.944797 2148 fragment_mgr.cpp:231] Got error while opening fragment 35895a325c6943dc-872eced6dfcb8c92: Cancelled: Cancelled I0312 10:58:07.944806 2203 plan_fragment_executor.cpp:673] Close() fragment_instance_id=35895a325c6943dc-872eced6dfcb8c91 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
