kangkaisen opened a new issue #838: CumulativeCompaction with HLL cause BE core dump URL: https://github.com/apache/incubator-doris/issues/838 **Describe the bug** ``` (gdb) bt #0 0x0000000000c577a0 in doris::HllSetResolver::fill_hash64_set (this=this@entry=0x7fe82693bf80, hash_set=0xb137889af84e6883) at /home/kangkaisen/palo/be/src/olap/hll.cpp:139 #1 0x0000000000c587a8 in fill_hash64_set (hash_set=<optimized out>, this=0x7fe82693bf80) at /home/kangkaisen/palo/be/src/olap/hll.cpp:91 #2 doris::HllSetHelper::fill_set (data=<optimized out>, context=0xd0eff248) at /home/kangkaisen/palo/be/src/olap/hll.cpp:217 #3 0x0000000000cb8f2c in aggregate (this=<optimized out>, src=<optimized out>, dest=<optimized out>) at /home/kangkaisen/palo/be/src/olap/field.h:186 #4 aggregate (rhs=<optimized out>, lhs=0x7fe82693e8d0, cids=...) at /home/kangkaisen/palo/be/src/olap/row_cursor.h:53 #5 doris::Reader::_agg_key_next_row (this=0x7fe82693ea70, row_cursor=0x7fe82693e8d0, eof=<optimized out>) at /home/kangkaisen/palo/be/src/olap/reader.cpp:400 #6 0x0000000000d2dfb3 in next_row_with_aggregation (eof=0x7fe82693e8bf, row_cursor=0x7fe82693e8d0, this=0x7fe82693ea70) at /home/kangkaisen/palo/be/src/olap/reader.h:115 #7 doris::Merger::merge (this=this@entry=0x7fe826941580, olap_data_arr=..., merged_rows=merged_rows@entry=0x7fe826941540, filted_rows=filted_rows@entry=0x7fe826941548) at /home/kangkaisen/palo/be/src/olap/merger.cpp:95 #8 0x0000000000d1940d in doris::CumulativeCompaction::_do_cumulative_compaction (this=this@entry=0x7fe8269466c0) at /home/kangkaisen/palo/be/src/olap/cumulative_compaction.cpp:378 #9 0x0000000000d19f65 in doris::CumulativeCompaction::run (this=this@entry=0x7fe8269466c0) at /home/kangkaisen/palo/be/src/olap/cumulative_compaction.cpp:152 #10 0x0000000000c5f766 in doris::OLAPEngine::perform_cumulative_compaction (this=this@entry=0x6659c00) at /home/kangkaisen/palo/be/src/olap/olap_engine.cpp:1706 #11 0x0000000000c83307 in doris::OLAPEngine::_cumulative_compaction_thread_callback (this=0x6659c00, arg=arg@entry=0x0) at /home/kangkaisen/palo/be/src/olap/olap_server.cpp:237 #12 0x0000000000c833af in operator() (__closure=<optimized out>) at /home/kangkaisen/palo/be/src/olap/olap_server.cpp:76 #13 __invoke_impl<void, doris::OLAPEngine::_start_bg_worker()::<lambda()> > (__f=...) at /usr/local/include/c++/7.2.0/bits/invoke.h:60 ``` The _set_type is `doris::HLL_DATA_EXPLICIT`, but `context.has_sparse_or_full` is true. **which is incompatible. So I think which should be a concurrent issue.** ``` (gdb) print resolver $1 = {_buf_ref = 0x693aab4b "\001\001|\234\266/dd\372\016\001\001\364>\352\t\275\353\361@\001\001\364>\352\t\275\353\361@", _buf_len = 10, _set_type = doris::HLL_DATA_EXPLICIT, _full_value_position = 0x0, _explicit_value = 0x693aab4d, _explicit_num = 1 '\001', _sparse_map = {_M_t = { _M_impl = {<std::allocator<std::_Rb_tree_node<std::pair<unsigned short const, unsigned char> > >> = {<__gnu_cxx::new_allocator<std::_Rb_tree_node<std::pair<unsigned short const, unsigned char> > >> = {<No data fields>}, <No data fields>}, <std::_Rb_tree_key_compare<std::less<unsigned short> >> = { _M_key_compare = {<std::binary_function<unsigned short, unsigned short, bool>> = {<No data fields>}, <No data fields>}}, <std::_Rb_tree_header> = {_M_header = {_M_color = std::_S_red, _M_parent = 0x0, _M_left = 0x7fe82693bfb0, _M_right = 0x7fe82693bfb0}, _M_node_count = 0}, <No data fields>}}}, _sparse_count = 0xcc4274 <doris::RowCursor::full_key_cmp(doris::RowCursor const&) const+148>} (gdb) print *context $3 = {has_value = true, has_sparse_or_full = true, registers = "\000\000\200\001\000\204\005\065\000\003\000\020\200\003\000\000\000\031\026\200V\000\000\000\325\000\000\000\000\000\200\000\000\002\001 \364\001\001\001\000\304\000\001\000\216\002\001\001\001\000\000@\001\000\000\000\220\321\000\001\000\374\023DP\202\000\200\000\200\001\000\003\000K\266\002\002$\210\000\001\060\004\236\001\002\000\000\000\000%\000\000\000\000\021\000\001$\000\001\000\242\001 \000\004\001\000M\003\000\000\224\000\060\r+\000\000\001\003\001\000\017\037\000\020\000\ae(\000\004)\000\001\255)\000\000P# \364\000\024\001\374\000\001\001\000\000\062\273P\001\256\001\000\000\000\307\024\000\001\000\000\001\a\005\005\001\000\000\000\000\000\000\004\000\001`\004\001\364\000\000a\000\000\364\000\374\004\364\001"..., hash64_set = 0xb137889af84e6883} ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
