kangkaisen commented on issue #838: CumulativeCompaction with HLL cause BE core dump URL: https://github.com/apache/incubator-doris/issues/838#issuecomment-478467521 I couldn't reproduce this bug in my dev cluster. But it's easy to reproduce this bug in our prod cluster: Only need to query a SQL: ``` select HLL_UNION_AGG(uuid) from table where partition_date = '2019-03-31'; ``` The following is the table schema ``` CREATE TABLE `table` ( `partition_date` date COMMENT "", `partition_event_type` varchar(10) COMMENT "", `partition_page_position` varchar(20) COMMENT "", `device_type` varchar(10) COMMENT "", `page_city_id` varchar(10) COMMENT "", `page_city_rank` varchar(10) COMMENT "", `app_version` varchar(100) COMMENT "", `flow_entrance` varchar(100) COMMENT "", `first_entrance` varchar(100) COMMENT "", `second_entrance` varchar(100) COMMENT "", `bu_name` varchar(100) COMMENT "", `uuid` hll HLL_UNION DEFAULT "0" COMMENT "", `user_id` hll HLL_UNION DEFAULT "0" COMMENT "" ) ENGINE=OLAP AGGREGATE KEY(`partition_date`, `partition_event_type`, `partition_page_position`, `device_type`, `page_city_id`, `page_city_rank`, `app_version`, `flow_entrance`, `first_entrance`, `second_entrance`, `bu_name`) PARTITION BY RANGE(`partition_date`) ``` The following is other stack: ``` *** SIGSEGV (@0x0) received by PID 22444 (TID 0x7fed7aef7700) from PID 0; stack trace: *** @ 0x7fed86b77280 (unknown) @ 0xc581d4 doris::HllSetHelper::set_max_register() @ 0xd726dc doris::AggregateFuncTraits<>::finalize() @ 0xcb937e doris::Reader::_agg_key_next_row() @ 0xd2dfb3 doris::Merger::merge() @ 0xd1940d doris::CumulativeCompaction::_do_cumulative_compaction() *** SIGSEGV (@0x3e39c000) received by PID 9879 (TID 0x7f7147df6700) from PID 1043972096; stack trace: *** @ 0x7f71a33152f0 (unknown) @ 0xc57915 doris::HllSetResolver::parse() @ 0xc582e1 doris::HllSetHelper::fill_set() @ 0xcb934b doris::Reader::_agg_key_next_row() @ 0xc6a34d doris::OLAPEngine::compute_checksum() @ 0x1122b13 doris::TaskWorkerPool::_check_consistency_worker_thread_callback() ``` **It seems when BE do CumulativeCompaction or compute_checksum and there is a HLL query at the same time, The BE will core dump.**
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
