您好！
我这边在使用broker load进行导入到doris时，一直存在会把be节点搞宕机，一直没有定位到关键问题。还请帮忙看一下问题
问题报错：be.out文件内容
terminate called after throwing an instance of 'orc::ParseError'
what(): Failed to read
hdfs://DATALAKE/warehouse/tablespace/managed/hive/test_winner_grp.db/ads_mpc_goods_sale_rt_pt_d_incr/part-00126-36dd66ba-a6a2-4625-ac38-0fc6cb2228c2-c000:
Internal error: Read from broker failed,
broker:TNetworkAddress(hostname=10.49.146.24, port=8000) failed:errors while
write data to output stream, cause by: Filesystem closed
*** Query id: 4360764793334480-9a89563a04dfc99b ***
*** Aborted at 1676191418 (unix time) try "date -d @1676191418" if you are
using GNU date ***
*** Current BE git commitID: Unknown ***
*** SIGABRT unkown detail explain (@0x1db2) received by PID 7602 (TID
0x7f28a59f9700) from PID 7602; stack trace: ***
0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*,
void*) at /root/doris/be/src/common/signal_handler.h:420
1# 0x00007F291215F3B0 in /lib64/libc.so.6
2# gsignal in /lib64/libc.so.6
3# __GI_abort in /lib64/libc.so.6
4# __gnu_cxx::__verbose_terminate_handler() [clone .cold] in
/data/doris-1.2.1/be/lib/doris_be
5# __cxxabiv1::__terminate(void (*)()) in /data/doris-1.2.1/be/lib/doris_be
6# 0x0000564F1207B7C1 in /data/doris-1.2.1/be/lib/doris_be
7# 0x0000564F1207B915 in /data/doris-1.2.1/be/lib/doris_be
8# doris::vectorized::ORCFileInputStream::read(void*, unsigned long, unsigned
long) [clone .cold] at /root/doris/be/src/vec/exec/format/orc/vorc_reader.cpp:67
9# orc::SeekableFileInputStream::Next(void const**, int*) in
/data/doris-1.2.1/be/lib/doris_be
10# orc::DecompressionStream::readBuffer(bool) in
/data/doris-1.2.1/be/lib/doris_be
11# orc::DecompressionStream::readHeader() in /data/doris-1.2.1/be/lib/doris_be
12# orc::DecompressionStream::Next(void const**, int*) in
/data/doris-1.2.1/be/lib/doris_be
13# orc::RleDecoderV2::next(long*, unsigned long, char const*) in
/data/doris-1.2.1/be/lib/doris_be
14# orc::StringDictionaryColumnReader::next(orc::ColumnVectorBatch&, unsigned
long, char*) in /data/doris-1.2.1/be/lib/doris_be
15# orc::StructColumnReader::next(orc::ColumnVectorBatch&, unsigned long,
char*) in /data/doris-1.2.1/be/lib/doris_be
16# orc::RowReaderImpl::next(orc::ColumnVectorBatch&) in
/data/doris-1.2.1/be/lib/doris_be
17# doris::vectorized::OrcReader::get_next_block(doris::vectorized::Block*,
unsigned long*, bool*) at
/root/doris/be/src/vec/exec/format/orc/vorc_reader.cpp:747
18# doris::vectorized::VFileScanner::_get_block_impl(doris::RuntimeState*,
doris::vectorized::Block*, bool*) at
/root/doris/be/src/vec/exec/scan/vfile_scanner.cpp:148
19# doris::vectorized::VScanner::get_block(doris::RuntimeState*,
doris::vectorized::Block*, bool*) at
/root/doris/be/src/vec/exec/scan/vscanner.cpp:53
20#
doris::vectorized::ScannerScheduler::_scanner_scan(doris::vectorized::ScannerScheduler*,
doris::vectorized::ScannerContext*, doris::vectorized::VScanner*) at
/root/doris/be/src/vec/exec/scan/scanner_scheduler.cpp:234
21# doris::ThreadPool::dispatch_thread() at
/root/doris/be/src/util/threadpool.cpp:542
22# doris::Thread::supervise_thread(void*) at
/root/doris/be/src/util/thread.cpp:455
23# start_thread in /lib64/libpthread.so.0
24# clone in /lib64/libc.so.6
be.warn文件内容：
W0212 16:43:38.025727 7742 broker_reader.cpp:186] Read from broker failed,
broker:TNetworkAddress(hostname=10.49.146.24, port=8000) failed:errors while
write data to output stream, cause by: Filesystem closed
W0212 16:43:50.535388 21144 cumulative_compaction.cpp:112] There are missed
versions among rowsets. prev rowset verison=[34235-34235], next rowset
version=[34237-34237],
tablet=1020778.276917532.244d8cd50094d83d-2beda143c376479f
W0212 16:43:50.837388 21144 cumulative_compaction.cpp:112] There are missed
versions among rowsets. prev rowset verison=[34235-34235], next rowset
version=[34237-34237],
tablet=1020802.276917532.044fcb9d5a58f77c-eb728622f29998b6
W0212 16:43:50.862862 21144 cumulative_compaction.cpp:112] There are missed
versions among rowsets. prev rowset verison=[34235-34235], next rowset
version=[34237-34237],
tablet=1020774.276917532.c044d2bf26a96a16-ab8648340b12a0be
W0212 16:43:51.010138 21144 cumulative_compaction.cpp:112] There are missed
versions among rowsets. prev rowset verison=[34181-34235], next rowset
version=[34237-34237],
tablet=1020810.276917532.8b4f63370dad3890-cb5a5c4c41153f83
W0212 16:43:51.035369 21144 cumulative_compaction.cpp:112] There are missed
versions among rowsets. prev rowset verison=[34205-34235], next rowset
version=[34237-34237],
tablet=1020798.276917532.e445a13b3295045e-4cb1238f530625bb
W0212 16:43:52.992830 21144 cumulative_compaction.cpp:112] There are missed
versions among rowsets. prev rowset verison=[34235-34235], next rowset
version=[34237-34237],
tablet=1020806.276917532.9d49f167f61a32a2-de4d451374a47cae
W0212 16:43:53.043406 21144 cumulative_compaction.cpp:112] There are missed
versions among rowsets. prev rowset verison=[34235-34235], next rowset
version=[34237-34237],
tablet=1020790.276917532.ec474f9b9e3b27fd-d96c05d874ce9186
W0212 16:43:53.068686 21144 cumulative_compaction.cpp:112] There are missed
versions among rowsets. prev rowset verison=[34235-34235], next rowset
version=[34237-34237],
tablet=1020786.276917532.89454e3d2fe4a0c2-6a494ce8f603a5ba
W0212 16:43:55.564836 21144 cumulative_compaction.cpp:112] There are missed
versions among rowsets. prev rowset verison=[34235-34235], next rowset
version=[34237-34237],
tablet=1020778.276917532.244d8cd50094d83d-2beda143c376479f
W0212 16:43:55.860325 21144 cumulative_compaction.cpp:112] There are missed
versions among rowsets. prev rowset verison=[34235-34235], next rowset
version=[34237-34237],
tablet=1020802.276917532.044fcb9d5a58f77c-eb728622f29998b6
W0212 16:43:55.885744 21144 cumulative_compaction.cpp:112] There are missed
versions among rowsets. prev rowset verison=[34235-34235], next rowset
version=[34237-34237],
tablet=1020774.276917532.c044d2bf26a96a16-ab8648340b12a0be
W0212 16:43:56.029886 21144 cumulative_compaction.cpp:112] There are missed
versions among rowsets. prev rowset verison=[34181-34235], next rowset
version=[34237-34237],
tablet=1020810.276917532.8b4f63370dad3890-cb5a5c4c41153f83
W0212 16:43:56.054003 21144 cumulative_compaction.cpp:112] There are missed
versions among rowsets. prev rowset verison=[34205-34235], next rowset
version=[34237-34237],
tablet=1020798.276917532.e445a13b3295045e-4cb1238f530625bb
W0212 16:43:58.011371 21144 cumulative_compaction.cpp:112] There are missed
versions among rowsets. prev rowset verison=[34235-34235], next rowset
version=[34237-34237],
tablet=1020806.276917532.9d49f167f61a32a2-de4d451374a47cae
W0212 16:43:58.062548 21144 cumulative_compaction.cpp:112] There are missed
versions among rowsets. prev rowset verison=[34235-34235], next rowset
version=[34237-34237],
tablet=1020790.276917532.ec474f9b9e3b27fd-d96c05d874ce9186
W0212 16:43:58.088730 21144 cumulative_compaction.cpp:112] There are missed
versions among rowsets. prev rowset verison=[34235-34235], next rowset
version=[34237-34237],
tablet=1020786.276917532.89454e3d2fe4a0c2-6a494ce8f603a5ba
be.log日志文件较大不方便粘贴 ，还请帮忙协助一下
感谢！
________________________________________
发件人: dev-h...@doris.apache.org <dev-h...@doris.apache.org>
发送时间: 2023年2月13日 9:19
收件人: 章志诚
主题: ?????????????confirm subscribe to dev@doris.apache.org
Hi! This is the ezmlm program. I'm managing the
dev@doris.apache.org mailing list.
I'm working for my owner, who can be reached
at dev-ow...@doris.apache.org.
To confirm that you would like
2...@winnermedical.com
added to the dev mailing list, please send
a short reply to this address:
dev-sc.1676251145.higodnbanpnlnbbodjok-2265=winnermedical....@doris.apache.org
Usually, this happens when you just hit the "reply" button.
If this does not work, simply copy the address and paste it into
the "To:" field of a new message.
or click here:
mailto:dev-sc.1676251145.higodnbanpnlnbbodjok-2265=winnermedical....@doris.apache.org
This confirmation serves two purposes. First, it verifies that I am able
to get mail through to you. Second, it protects you in case someone
forges a subscription request in your name.
Please note that ALL Apache dev- and user- mailing lists are publicly
archived. Do familiarize yourself with Apache's public archive policy at
http://www.apache.org/foundation/public-archives.html
prior to subscribing and posting messages to dev@doris.apache.org.
If you're not sure whether or not the policy applies to this mailing list,
assume it does unless the list name contains the word "private" in it.
Some mail programs are broken and cannot handle long addresses. If you
cannot reply to this request, instead send a message to
<dev-requ...@doris.apache.org> and put the
entire address listed above into the "Subject:" line.
--- Administrative commands for the dev list ---
I can handle administrative requests automatically. Please
do not send them to the list address! Instead, send
your message to the correct command address:
To subscribe to the list, send a message to:
<dev-subscr...@doris.apache.org>
To remove your address from the list, send a message to:
<dev-unsubscr...@doris.apache.org>
Send mail to the following for info and FAQ for this list:
<dev-i...@doris.apache.org>
<dev-...@doris.apache.org>
Similar addresses exist for the digest list:
<dev-digest-subscr...@doris.apache.org>
<dev-digest-unsubscr...@doris.apache.org>
To get messages 123 through 145 (a maximum of 100 per request), mail:
<dev-get.123_...@doris.apache.org>
To get an index with subject and author for messages 123-456 , mail:
<dev-index.123_...@doris.apache.org>
They are always returned as sets of 100, max 2000 per request,
so you'll actually get 100-499.
To receive all messages with the same subject as message 12345,
send a short message to:
<dev-thread.12...@doris.apache.org>
The messages should contain one line or word of text to avoid being
treated as sp@m, but I will ignore their content.
Only the ADDRESS you send to is important.
You can start a subscription for an alternate address,
for example "john@host.domain", just add a hyphen and your
address (with '=' instead of '@') after the command word:
<dev-subscribe-john=host.dom...@doris.apache.org>
To stop subscription for this address, mail:
<dev-unsubscribe-john=host.dom...@doris.apache.org>
In both cases, I'll send a confirmation message to that address. When
you receive it, simply reply to it to complete your subscription.
If despite following these instructions, you do not get the
desired results, please contact my owner at
dev-ow...@doris.apache.org. Please be patient, my owner is a
lot slower than I am ;-)
--- Enclosed is a copy of the request I received.
Return-Path: <2...@winnermedical.com>
Received: (qmail 237756 invoked by uid 116); 13 Feb 2023 01:19:04 -0000
Received: from spamproc1-he-de.apache.org (HELO spamproc1-he-de.apache.org)
(116.203.196.100)
by apache.org (qpsmtpd/0.94) with ESMTP; Mon, 13 Feb 2023 01:19:04 +0000
Authentication-Results: apache.org; auth=none
Received: from localhost (localhost [127.0.0.1])
by spamproc1-he-de.apache.org (ASF Mail Server at
spamproc1-he-de.apache.org) with ESMTP id D477D1FF6C3
for <dev-subscr...@doris.apache.org>; Mon, 13 Feb 2023 01:19:04 +0000
(UTC)
X-Virus-Scanned: Debian amavisd-new at spamproc1-he-de.apache.org
X-Spam-Flag: NO
X-Spam-Score: 3.924
X-Spam-Level: ***
X-Spam-Status: No, score=3.924 tagged_above=-999 required=6.31
tests=[HTML_MESSAGE=0.2, MPART_ALT_DIFF=0.724,
RCVD_IN_DNSWL_BLOCKED=0.001, RDNS_NONE=3, SPF_PASS=-0.001]
autolearn=disabled
Received: from mx1-ec2-va.apache.org ([116.203.227.195])
by localhost (spamproc1-he-de.apache.org [116.203.196.100])
(amavisd-new, port 10024)
with ESMTP id ypJns8XRVylS for <dev-subscr...@doris.apache.org>;
Mon, 13 Feb 2023 01:19:04 +0000 (UTC)
Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=103.194.244.106;
helo=spam.winnermedical.com; envelope-from=2...@winnermedical.com;
receiver=<UNKNOWN>
Received: from spam.winnermedical.com (unknown [103.194.244.106])
by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org)
with ESMTP id 5385FBCA28
for <dev-subscr...@doris.apache.org>; Mon, 13 Feb 2023 01:19:01 +0000
(UTC)
Received: from SR-MBX-01.winnermedical.com ([172.16.100.30])
by spam.winnermedical.com with ESMTPS id 31D1IM8w074938
(version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=FAIL)
for <dev-subscr...@doris.apache.org>; Mon, 13 Feb 2023 09:18:22 +0800
(GMT-8)
(envelope-from 2...@winnermedical.com)
Received: from SR-MBX-02.winnermedical.com (172.16.100.32) by
SR-MBX-01.winnermedical.com (172.16.100.30) with Microsoft SMTP Server (TLS)
id 15.0.1497.2; Mon, 13 Feb 2023 09:18:22 +0800
Received: from SR-MBX-02.winnermedical.com ([fe80::68de:3d29:2c94:cc8a]) by
SR-MBX-02.winnermedical.com ([fe80::68de:3d29:2c94:cc8a%18]) with mapi id
15.00.1497.000; Mon, 13 Feb 2023 09:18:22 +0800
From: <2...@winnermedical.com>
To: <dev-subscr...@doris.apache.org>
Subject: =?gb2312?B?ZG9yaXO1xGJlvdq14+W0u/o=?=
Thread-Topic: =?gb2312?B?ZG9yaXO1xGJlvdq14+W0u/o=?=
Thread-Index: AQHZP0kQY6g1r6ny0U2uaQQ6QD8VsQ==
Date: Mon, 13 Feb 2023 01:18:21 +0000
Message-ID: <8e24767e4dea49b88d0e655311aaf...@sr-mbx-02.winnermedical.com>
Accept-Language: zh-CN, en-US
Content-Language: zh-CN
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-ms-exchange-transport-fromentityheader: Hosted
x-originating-ip: [10.10.48.13]
Content-Type: multipart/alternative;
boundary="_000_8e24767e4dea49b88d0e655311aaf370SRMBX02winnermedicalcom_"
MIME-Version: 1.0
X-DNSRBL:
X-SPAM-SOURCE-CHECK: pass
X-MAIL:spam.winnermedical.com 31D1IM8w074938
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org
For additional commands, e-mail: dev-h...@doris.apache.org
