zhaopinglu opened a new issue, #28134: URL: https://github.com/apache/doris/issues/28134
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Version 2.0.2-bin-x64 ### What's Wrong? I created a ngram bloomfilter index then ran build command on it. Then all be crashed. ### What You Expected? All BE can startup and work as normal. ### How to Reproduce? step 1: create a table say lineitem as below, then insert some lines Note: Actually this table was created by tpch-tool. But I don't think its relevant. CREATE TABLE `lineitem` ( `l_shipdate` date NOT NULL, `l_orderkey` bigint(20) NOT NULL, `l_linenumber` int(11) NOT NULL, `l_partkey` int(11) NOT NULL, `l_suppkey` int(11) NOT NULL, `l_quantity` DECIMAL(15, 2) NOT NULL, `l_extendedprice` DECIMAL(15, 2) NOT NULL, `l_discount` DECIMAL(15, 2) NOT NULL, `l_tax` DECIMAL(15, 2) NOT NULL, `l_returnflag` varchar(1) NOT NULL, `l_linestatus` varchar(1) NOT NULL, `l_commitdate` date NOT NULL, `l_receiptdate` date NOT NULL, `l_shipinstruct` varchar(25) NOT NULL, `l_shipmode` varchar(10) NOT NULL, `l_comment` varchar(44) NOT NULL ) ENGINE=OLAP UNIQUE KEY(`l_shipdate`, `l_orderkey`) COMMENT 'OLAP' DISTRIBUTED BY HASH(`l_orderkey`) BUCKETS 96 step 2: create a ngram bloomfilter on lineitem alter table lineitem add index idx_ngram_(l_comment) using NGRAM_BF PROPERTIES("gram_size"="3", "bf_size"="512"); step 3: build the index which created in previous step. build index idx_ngram_ on lineitem; ### Anything Else? I know I probably should not run 'build index' on an ngram bloomfilter index. But Doris didn't reject it when run the command. Crash stack: start time: 2023年 12月 07日 星期四 18:24:09 CST INFO: java_cmd /usr/lib/jvm/openlogic-openjdk-8-hotspot/bin/java INFO: jdk_version 8 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/data/apache-doris-2.0.2-bin-x64/be/lib/java_extensions/preload-extensions/preload-extensions-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/data/apache-doris-2.0.2-bin-x64/be/lib/java_extensions/java-udf/java-udf-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/data/apache-doris-2.0.2-bin-x64/be/lib/hadoop_hdfs/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory] OpenJDK 64-Bit Server VM warning: You have loaded library /data/apache-doris-2.0.2-bin-x64/be/lib/hadoop_hdfs/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now. It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'. *** Query id: 0-0 *** *** tablet id: 0 *** *** Aborted at 1701944660 (unix time) try "date -d @1701944660" if you are using GNU date *** *** Current BE git commitID: ae923f7 *** *** SIGSEGV address not mapped to object (@0x30) received by PID 247774 (TID 248522 OR 0x7e67a769f700) from PID 48; stack trace: *** 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /root/src/doris-2.0/be/src/common/signal_handler.h:417 1# os::Linux::chained_handler(int, siginfo_t*, void*) in /usr/lib/jvm/openlogic-openjdk-8-hotspot/jre/lib/amd64/server/libjvm.so 2# JVM_handle_linux_signal in /usr/lib/jvm/openlogic-openjdk-8-hotspot/jre/lib/amd64/server/libjvm.so 3# signalHandler(int, siginfo_t*, void*) in /usr/lib/jvm/openlogic-openjdk-8-hotspot/jre/lib/amd64/server/libjvm.so 4# 0x00007F091D6ECB80 in /usr/lib64/libc.so.6 5# doris::vectorized::OlapBlockDataConvertor::convert_column_data(unsigned long) at /root/src/doris-2.0/be/src/vec/olap/olap_data_convertor.cpp:222 6# doris::IndexBuilder::_write_inverted_index_data(std::shared_ptr<doris::TabletSchema>, int, doris::vectorized::Block*) at /root/src/doris-2.0/be/src/olap/task/index_builder.cpp:267 7# doris::IndexBuilder::handle_single_rowset(std::shared_ptr<doris::RowsetMeta>, std::vector<std::shared_ptr<doris::segment_v2::Segment>, std::allocator<std::shared_ptr<doris::segment_v2::Segment> > >&) at /root/src/doris-2.0/be/src/olap/task/index_builder.cpp:230 8# doris::IndexBuilder::handle_inverted_index_data() at /root/src/doris-2.0/be/src/olap/task/index_builder.cpp:397 9# doris::IndexBuilder::do_build_inverted_index() in /root/doris/be/lib/doris_be 10# doris::StorageEngine::_handle_index_change(std::shared_ptr<doris::IndexBuilder>) at /root/src/doris-2.0/be/src/olap/olap_server.cpp:1039 11# doris::StorageEngine::process_index_change_task(doris::TAlterInvertedIndexReq const&) at /root/src/doris-2.0/be/src/olap/olap_server.cpp:1033 12# doris::EngineIndexChangeTask::execute() at /root/src/doris-2.0/be/src/olap/task/engine_index_change_task.cpp:43 13# doris::StorageEngine::execute_task(doris::EngineTask*) at /root/src/doris-2.0/be/src/olap/storage_engine.cpp:1168 14# doris::TaskWorkerPool::_alter_inverted_index_worker_thread_callback() at /root/src/doris-2.0/be/src/agent/task_worker_pool.cpp:354 15# doris::ThreadPool::dispatch_thread() in /root/doris/be/lib/doris_be 16# doris::Thread::supervise_thread(void*) at /root/src/doris-2.0/be/src/util/thread.cpp:470 17# start_thread in /usr/lib64/libpthread.so.0 18# clone in /usr/lib64/libc.so.6 ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
