freemandealer opened a new issue, #14447: URL: https://github.com/apache/doris/issues/14447
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Version Nov 15 master ### What's Wrong? ``` start time: Mon 14 Nov 2022 08:05:12 PM CST F1115 00:08:50.003960 1323563 zone_map_index.cpp:156] Check failed: num_to_read == num_read *** Check failure stack trace: *** @ 0x560899fa83fd google::LogMessage::Fail() @ 0x560899faa939 google::LogMessage::SendToLog() @ 0x560899fa7f66 google::LogMessage::Flush() @ 0x560899faafa9 google::LogMessageFatal::~LogMessageFatal() @ 0x56088f305280 doris::segment_v2::ZoneMapIndexReader::load() @ 0x56088ef12765 doris::segment_v2::ColumnReader::_load_zone_map_index() @ 0x56088ef2f4ef _ZZN5doris10segment_v212ColumnReader20_ensure_index_loadedEvENKUlvE_clEv @ 0x56088ef347b7 _ZZN5doris13DorisCallOnceINS_6StatusEE4callIZNS_10segment_v212ColumnReader20_ensure_index_loadedEvEUlvE_EES1_T_ENKUlvE_clEv @ 0x56088ef42908 _ZSt13__invoke_implIvZN5doris13DorisCallOnceINS0_6StatusEE4callIZNS0_10segment_v212ColumnReader20_ensure_index_loadedEvEUlvE_EES2_T_EUlvE_JEES8_St14__invoke_otherOT0_DpOT1_ @ 0x56088ef409e6 _ZSt8__invokeIZN5doris13DorisCallOnceINS0_6StatusEE4callIZNS0_10segment_v212ColumnReader20_ensure_index_loadedEvEUlvE_EES2_T_EUlvE_JEENSt15__invoke_resultIS8_JDpT0_EE4typeEOS8_DpOSB_ @ 0x56088ef3b460 _ZZSt9call_onceIZN5doris13DorisCallOnceINS0_6StatusEE4callIZNS0_10segment_v212ColumnReader20_ensure_index_loadedEvEUlvE_EES2_T_EUlvE_JEEvRSt9once_flagOS8_DpOT0_ENKUlvE_clEv @ 0x56088ef40a09 _ZZNSt9once_flag18_Prepare_executionC4IZSt9call_onceIZN5doris13DorisCallOnceINS3_6StatusEE4callIZNS3_10segment_v212ColumnReader20_ensure_index_loadedEvEUlvE_EES5_T_EUlvE_JEEvRS_OSB_DpOT0_EUlvE_EERSB_ENKUlvE_clEv @ 0x56088ef40a1a _ZZNSt9once_flag18_Prepare_executionC4IZSt9call_onceIZN5doris13DorisCallOnceINS3_6StatusEE4callIZNS3_10segment_v212ColumnReader20_ensure_index_loadedEvEUlvE_EES5_T_EUlvE_JEEvRS_OSB_DpOT0_EUlvE_EERSB_ENUlvE_4_FUNEv @ 0x7fbf8b3bd47f __pthread_once_slow @ 0x56088ef04d18 __gthread_once() @ 0x56088ef3b561 _ZSt9call_onceIZN5doris13DorisCallOnceINS0_6StatusEE4callIZNS0_10segment_v212ColumnReader20_ensure_index_loadedEvEUlvE_EES2_T_EUlvE_JEEvRSt9once_flagOS8_DpOT0_ @ 0x56088ef349fd _ZN5doris13DorisCallOnceINS_6StatusEE4callIZNS_10segment_v212ColumnReader20_ensure_index_loadedEvEUlvE_EES1_T_ @ 0x56088ef2fc57 doris::segment_v2::ColumnReader::_ensure_index_loaded() @ 0x56088ef13573 doris::segment_v2::ColumnReader::seek_at_or_before() @ 0x56088ef1aaa4 doris::segment_v2::FileColumnIterator::seek_to_ordinal() @ 0x56088f1a4333 doris::segment_v2::SegmentIterator::_seek_columns() @ 0x56088f1ab3a6 doris::segment_v2::SegmentIterator::_read_columns_by_index() @ 0x56088f1ae474 doris::segment_v2::SegmentIterator::next_batch() @ 0x5608992177e5 doris::vectorized::VMergeIteratorContext::_load_next_block() @ 0x560899216971 doris::vectorized::VMergeIteratorContext::init() @ 0x560899218346 doris::vectorized::VMergeIterator::init() @ 0x56088fd52d1c doris::BetaRowsetReader::init() @ 0x56089923514c doris::vectorized::BlockReader::_init_collect_iter() @ 0x56089923724d doris::vectorized::BlockReader::init() @ 0x56088e280679 doris::Merger::vmerge_rowsets() @ 0x56088e249434 doris::Compaction::do_compaction_impl() @ 0x56088e247e37 doris::Compaction::do_compaction() *** Query id: 0-0 *** *** Aborted at 1668442130 (unix time) try "date -d @1668442130" if you are using GNU date *** *** Current BE git commitID: b0ff852d7 *** *** SIGABRT unkown detail explain (@0x142e46) received by PID 1322566 (TID 0x7fbe03ede700) from PID 1322566; stack trace: *** 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /home/zcp/repo_center/doris_master/be/src/common/signal_handler.h:420 1# 0x00007FBF8B4120C0 in /lib/x86_64-linux-gnu/libc.so.6 2# raise in /lib/x86_64-linux-gnu/libc.so.6 3# abort in /lib/x86_64-linux-gnu/libc.so.6 4# 0x0000560899FB2DE9 in /mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be 5# 0x0000560899FA83FD in /mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be 6# google::LogMessage::SendToLog() in /mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be 7# google::LogMessage::Flush() in /mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be 8# google::LogMessageFatal::~LogMessageFatal() in /mnt/ssd01/doris-master/VEC_ASAN/be/lib/doris_be 9# doris::segment_v2::ZoneMapIndexReader::load(bool, bool) at /home/zcp/repo_center/doris_master/be/src/olap/rowset/segment_v2/zone_map_index.cpp:156 10# doris::segment_v2::ColumnReader::_load_zone_map_index(bool, bool) at /home/zcp/repo_center/doris_master/be/src/olap/rowset/segment_v2/column_reader.cpp:351 11# doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}::operator()() const at /home/zcp/repo_center/doris_master/be/src/olap/rowset/segment_v2/column_reader.h:167 12# doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}::operator()() const at /home/zcp/repo_center/doris_master/be/src/util/once.h:57 13# void std::__invoke_impl<void, doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}>(std::__invoke_other, doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}&&) at /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:61 14# std::__invoke_result<doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}>::type std::__invoke<doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}>(doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}&&) at /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:97 15# std::call_once<doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}>(std::once_flag&, doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}&&)::{lambda()#1}::operator()() const at /var/local/ldb_toolchain/include/c++/11/mutex:775 16# std::once_flag::_Prepare_execution::_Prepare_execution<std::call_once<doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}>(std::once_flag&, doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}&&)::{lambda()#1}>(doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}&)::{lambda()#1}::operator()() const at /var/local/ldb_toolchain/include/c++/11/mutex:712 17# std::once_flag::_Prepare_execution::_Prepare_execution<std::call_once<doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}>(std::once_flag&, doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}&&)::{lambda()#1}>(doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}&)::{lambda()#1}::_FUN() at /var/local/ldb_toolchain/include/c++/11/mutex:712 18# __pthread_once_slow at /build/glibc-sMfBJT/glibc-2.31/nptl/pthread_once.c:118 19# __gthread_once(int*, void (*)()) at /var/local/ldb_toolchain/include/x86_64-linux-gnu/c++/11/bits/gthr-default.h:700 20# void std::call_once<doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}>(std::once_flag&, doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1})::{lambda()#1}&&) at /var/local/ldb_toolchain/include/c++/11/mutex:783 21# doris::Status doris::DorisCallOnce<doris::Status>::call<doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}>(doris::segment_v2::ColumnReader::_ensure_index_loaded()::{lambda()#1}) at /home/zcp/repo_center/doris_master/be/src/util/once.h:57 22# doris::segment_v2::ColumnReader::_ensure_index_loaded() at /home/zcp/repo_center/doris_master/be/src/olap/rowset/segment_v2/column_reader.h:173 23# doris::segment_v2::ColumnReader::seek_at_or_before(unsigned long, doris::segment_v2::OrdinalPageIndexIterator*) at /home/zcp/repo_center/doris_master/be/src/olap/rowset/segment_v2/column_reader.cpp:382 24# doris::segment_v2::FileColumnIterator::seek_to_ordinal(unsigned long) at /home/zcp/repo_center/doris_master/be/src/olap/rowset/segment_v2/column_reader.cpp:650 25# doris::segment_v2::SegmentIterator::_seek_columns(std::vector<unsigned int, std::allocator<unsigned int> > const&, unsigned int) at /home/zcp/repo_center/doris_master/be/src/olap/rowset/segment_v2/segment_iterator.cpp:582 26# doris::segment_v2::SegmentIterator::_read_columns_by_index(unsigned int, unsigned int&, bool) at /home/zcp/repo_center/doris_master/be/src/olap/rowset/segment_v2/segment_iterator.cpp:954 27# doris::segment_v2::SegmentIterator::next_batch(doris::vectorized::Block*) at /home/zcp/repo_center/doris_master/be/src/olap/rowset/segment_v2/segment_iterator.cpp:1112 28# doris::vectorized::VMergeIteratorContext::_load_next_block() at /home/zcp/repo_center/doris_master/be/src/vec/olap/vgeneric_iterators.cpp:294 29# doris::vectorized::VMergeIteratorContext::init(doris::StorageReadOptions const&) at /home/zcp/repo_center/doris_master/be/src/vec/olap/vgeneric_iterators.cpp:254 30# doris::vectorized::VMergeIterator::init(doris::StorageReadOptions const&) at /home/zcp/repo_center/doris_master/be/src/vec/olap/vgeneric_iterators.cpp:321 31# doris::BetaRowsetReader::init(doris::RowsetReaderContext*) at /home/zcp/repo_center/doris_master/be/src/olap/rowset/beta_rowset_reader.cpp:203 32# doris::vectorized::BlockReader::_init_collect_iter(doris::TabletReader::ReaderParams const&, std::vector<std::shared_ptr<doris::RowsetReader>, std::allocator<std::shared_ptr<doris::RowsetReader> > >*) at /home/zcp/repo_center/doris_master/be/src/vec/olap/block_reader.cpp:54 33# doris::vectorized::BlockReader::init(doris::TabletReader::ReaderParams const&) at /home/zcp/repo_center/doris_master/be/src/vec/olap/block_reader.cpp:130 34# doris::Merger::vmerge_rowsets(std::shared_ptr<doris::Tablet>, doris::ReaderType, std::shared_ptr<doris::TabletSchema>, std::vector<std::shared_ptr<doris::RowsetReader>, std::allocator<std::shared_ptr<doris::RowsetReader> > > const&, doris::RowsetWriter*, doris::Merger::Statistics*) at /home/zcp/repo_center/doris_master/be/src/olap/merger.cpp:142 35# doris::Compaction::do_compaction_impl(long) at /home/zcp/repo_center/doris_master/be/src/olap/compaction.cpp:163 36# doris::Compaction::do_compaction(long) at /home/zcp/repo_center/doris_master/be/src/olap/compaction.cpp:112 37# doris::CumulativeCompaction::execute_compact_impl() at /home/zcp/repo_center/doris_master/be/src/olap/cumulative_compaction.cpp:77 38# doris::Compaction::execute_compact() at /home/zcp/repo_center/doris_master/be/src/olap/compaction.cpp:50 39# doris::Tablet::execute_compaction(doris::CompactionType) at /home/zcp/repo_center/doris_master/be/src/olap/tablet.cpp:1580 40# doris::StorageEngine::_submit_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType)::{lambda()#1}::operator()() const at /home/zcp/repo_center/doris_master/be/src/olap/olap_server.cpp:636 41# void std::__invoke_impl<void, doris::StorageEngine::_submit_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType)::{lambda()#1}&>(std::__invoke_other, doris::StorageEngine::_submit_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType)::{lambda()#1}&) at /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:61 42# std::enable_if<is_invocable_r_v<void, doris::StorageEngine::_submit_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType)::{lambda()#1}&>, void>::type std::__invoke_r<void, doris::StorageEngine::_submit_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType)::{lambda()#1}&>(doris::StorageEngine::_submit_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType)::{lambda()#1}&) at /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:117 43# std::_Function_handler<void (), doris::StorageEngine::_submit_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType)::{lambda()#1}>::_M_invoke(std::_Any_data const&) at /var/local/ldb_toolchain/include/c++/11/bits/std_function.h:292 44# std::function<void ()>::operator()() const at /var/local/ldb_toolchain/include/c++/11/bits/std_function.h:560 45# doris::FunctionRunnable::run() at /home/zcp/repo_center/doris_master/be/src/util/threadpool.cpp:45 46# doris::ThreadPool::dispatch_thread() at /home/zcp/repo_center/doris_master/be/src/util/threadpool.cpp:542 47# void std::__invoke_impl<void, void (doris::ThreadPool::*&)(), doris::ThreadPool*&>(std::__invoke_memfun_deref, void (doris::ThreadPool::*&)(), doris::ThreadPool*&) at /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:74 48# std::__invoke_result<void (doris::ThreadPool::*&)(), doris::ThreadPool*&>::type std::__invoke<void (doris::ThreadPool::*&)(), doris::ThreadPool*&>(void (doris::ThreadPool::*&)(), doris::ThreadPool*&) at /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:97 49# void std::_Bind<void (doris::ThreadPool::*(doris::ThreadPool*))()>::__call<void, , 0ul>(std::tuple<>&&, std::_Index_tuple<0ul>) at /var/local/ldb_toolchain/include/c++/11/functional:422 50# void std::_Bind<void (doris::ThreadPool::*(doris::ThreadPool*))()>::operator()<, void>() at /var/local/ldb_toolchain/include/c++/11/functional:505 51# void std::__invoke_impl<void, std::_Bind<void (doris::ThreadPool::*(doris::ThreadPool*))()>&>(std::__invoke_other, std::_Bind<void (doris::ThreadPool::*(doris::ThreadPool*))()>&) at /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:61 52# std::enable_if<is_invocable_r_v<void, std::_Bind<void (doris::ThreadPool::*(doris::ThreadPool*))()>&>, void>::type std::__invoke_r<void, std::_Bind<void (doris::ThreadPool::*(doris::ThreadPool*))()>&>(std::_Bind<void (doris::ThreadPool::*(doris::ThreadPool*))()>&) at /var/local/ldb_toolchain/include/c++/11/bits/invoke.h:117 53# std::_Function_handler<void (), std::_Bind<void (doris::ThreadPool::*(doris::ThreadPool*))()> >::_M_invoke(std::_Any_data const&) at /var/local/ldb_toolchain/include/c++/11/bits/std_function.h:292 54# std::function<void ()>::operator()() const at /var/local/ldb_toolchain/include/c++/11/bits/std_function.h:560 55# doris::Thread::supervise_thread(void*) at /home/zcp/repo_center/doris_master/be/src/util/thread.cpp:455 ```  ### What You Expected? check success ### How to Reproduce? haven't reproduce yet. maybe enable_segcompaction ### Anything Else? _No response_ ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
