seanfulton commented on issue #29378:
URL: https://github.com/apache/doris/issues/29378#issuecomment-1877251253
I updated be.conf with the segment_cache_capacity=10000 and restarted the
three BE nodes. Still getting the same error in the same place. Again, these
are relatively small files with mysql insert statements generated by mysqldump.
I have a shell script that pipes the contents of the file into mysql -P9030,
so each table is a new connection to doris. This is happening on every single
file, all but one are less than 1 G
Error:
0# doris::Exception::Exception(int, std::basic_string_view<char,
std::char_traits<char> >) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_6
Done with web_device.sql!
Loading web_os.sql ...
ERROR 1105 (HY000) at line 35: errCode = 2, detailMessage =
(10.10.21.14)[MEM_ALLOC_FAILED]Create Expr failed because [E11] Allocator sys
memory check failed: Cannot alloc:64, consuming tracker:<Load#Id=ba3be
2681a0d4635-8bea3f5473715482>, peak used 0, current used 0, exec node:<>,
process memory used 77.24 GB exceed limit 76.80 GB or sys available memory
18.85 GB less than low water mark 1.60 GB.
0# doris::Exception::Exception(int, std::basic_string_view<char,
std::char_traits<char> >) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_6
Done with web_os.sql!
Loading web_referrer.sql ...
ERROR 1105 (HY000) at line 35: errCode = 2, detailMessage =
(10.10.21.14)[MEM_ALLOC_FAILED]Create Expr failed because [E11] Allocator sys
memory check failed: Cannot alloc:64, consuming tracker:<Load#Id=e4aa2
acb46e94cd9-8906c1b443022160>, peak used 0, current used 0, exec node:<>,
process memory used 77.24 GB exceed limit 76.80 GB or sys available memory
18.85 GB less than low water mark 1.60 GB.
0# doris::Exception::Exception(int, std::basic_string_view<char,
std::char_traits<char> >) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_6
Done with web_referrer.sql!
Loading web_segment.sql ...
ERROR 1105 (HY000) at line 35: errCode = 2, detailMessage =
(10.10.21.14)[MEM_ALLOC_FAILED]Create Expr failed because [E11] Allocator sys
memory check failed: Cannot alloc:64, consuming tracker:<Load#Id=ae5c5
3468384e87-9bf5c7ef84169cf4>, peak used 0, current used 0, exec node:<>,
process memory used 77.24 GB exceed limit 76.80 GB or sys available memory
18.85 GB less than low water mark 1.60 GB.
0# doris::Exception::Exception(int, std::basic_string_view<char,
std::char_traits<char> >) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64
Done with web_segment.sql!
Loading web_social.sql ...
ERROR 1105 (HY000) at line 35: errCode = 2, detailMessage =
(10.10.21.14)[MEM_ALLOC_FAILED]Create Expr failed because [E11] Allocator sys
memory check failed: Cannot alloc:64, consuming tracker:<Load#Id=550b7
cabf404250-940d301bb7dca3be>, peak used 0, current used 0, exec node:<>,
process memory used 77.24 GB exceed limit 76.80 GB or sys available memory
18.85 GB less than low water mark 1.60 GB.
0# doris::Exception::Exception(int, std::basic_string_view<char,
std::char_traits<char> >) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
