[
https://issues.apache.org/jira/browse/IMPALA-11296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17552021#comment-17552021
]
Quanlong Huang commented on IMPALA-11296:
-----------------------------------------
I can reproduce the issue on the 3.x branch:
{code:java}
Thread 1 (process 8963):
#0 0x000000000267391e in impala::HdfsScanner::InitTupleFromTemplate
(this=0x12aff400, template_tuple=0x157bd000, tuple=0x144e9b92,
tuple_byte_size=5) at /var/lib/jenkins/impala/be/src/exec/hdfs-scanner.h:537
#1 0x00000000026c89bd in impala::HdfsScanner::InitTupleBuffer
(this=0x12aff400, template_tuple=0x157bd000, tuple_mem=0x144e9b92 "",
num_tuples=1024) at /var/lib/jenkins/impala/be/src/exec/hdfs-scanner.h:552
#2 0x00000000026c777e in impala::HdfsOrcScanner::TransferTuples
(this=0x12aff400, coll_reader=0x138aefc0, dst_batch=0x13c4aa80,
do_batch_read=true) at
/var/lib/jenkins/impala/be/src/exec/hdfs-orc-scanner.cc:728
#3 0x00000000026c65c1 in impala::HdfsOrcScanner::AssembleRows
(this=0x12aff400, row_batch=0x13c4aa80) at
/var/lib/jenkins/impala/be/src/exec/hdfs-orc-scanner.cc:683
#4 0x00000000026c4ea1 in impala::HdfsOrcScanner::GetNextInternal
(this=0x12aff400, row_batch=0x13c4aa80) at
/var/lib/jenkins/impala/be/src/exec/hdfs-orc-scanner.cc:560
#5 0x00000000026c3832 in impala::HdfsOrcScanner::ProcessSplit
(this=0x12aff400) at /var/lib/jenkins/impala/be/src/exec/hdfs-orc-scanner.cc:468
#6 0x00000000027de5ae in impala::HdfsScanNode::ProcessSplit (this=0x1095c400,
filter_ctxs=..., expr_results_pool=0x7f2814ca4410, scan_range=0x13ab44c0,
scanner_thread_reservation=0x7f2814ca4368) at
/var/lib/jenkins/impala/be/src/exec/hdfs-scan-node.cc:515
#7 0x00000000027dd783 in impala::HdfsScanNode::ScannerThread (this=0x1095c400,
first_thread=true, scanner_thread_reservation=8192) at
/var/lib/jenkins/impala/be/src/exec/hdfs-scan-node.cc:417
#8 0x00000000027dcae0 in impala::HdfsScanNode::<lambda()>::operator()(void)
const (__closure=0x7f2814ca4b98) at
/var/lib/jenkins/impala/be/src/exec/hdfs-scan-node.cc:338
#9 0x00000000027df0d4 in
boost::detail::function::void_function_obj_invoker0<impala::HdfsScanNode::ThreadTokenAvailableCb(impala::ThreadResourcePool*)::<lambda()>,
void>::invoke(boost::detail::function::function_buffer &)
(function_obj_ptr=...) at
/var/lib/jenkins/impala/toolchain/boost-1.61.0-p2/include/boost/function/function_template.hpp:159
#10 0x0000000001fc944c in boost::function0<void>::operator()
(this=0x7f2814ca4b90) at
/var/lib/jenkins/impala/toolchain/boost-1.61.0-p2/include/boost/function/function_template.hpp:771
#11 0x000000000258a2ff in impala::Thread::SuperviseThread(std::string const&,
std::string const&, boost::function<void ()>, impala::ThreadDebugInfo const*,
impala::Promise<long, (impala::PromiseMode)0>*) (name=..., category=...,
functor=..., parent_thread_info=0x7f281169e840, thread_started=0x7f281169d660)
at /var/lib/jenkins/impala/be/src/util/thread.cc:360
#12 0x0000000002592583 in boost::_bi::list5<boost::_bi::value<std::string>,
boost::_bi::value<std::string>, boost::_bi::value<boost::function<void ()> >,
boost::_bi::value<impala::ThreadDebugInfo*>,
boost::_bi::value<impala::Promise<long, (impala::PromiseMode)0>*>
>::operator()<void (*)(std::string const&, std::string const&,
boost::function<void ()>, impala::ThreadDebugInfo const*, impala::Promise<long,
(impala::PromiseMode)0>*), boost::_bi::list0>(boost::_bi::type<void>, void
(*&)(std::string const&, std::string const&, boost::function<void ()>,
impala::ThreadDebugInfo const*, impala::Promise<long,
(impala::PromiseMode)0>*), boost::_bi::list0&, int) (this=0x13557dc0,
f=@0x13557db8: 0x2589f98 <impala::Thread::SuperviseThread(std::string const&,
std::string const&, boost::function<void ()>, impala::ThreadDebugInfo const*,
impala::Promise<long, (impala::PromiseMode)0>*)>, a=...) at
/var/lib/jenkins/impala/toolchain/boost-1.61.0-p2/include/boost/bind/bind.hpp:531
#13 0x00000000025924a7 in boost::_bi::bind_t<void, void (*)(std::string const&,
std::string const&, boost::function<void ()>, impala::ThreadDebugInfo const*,
impala::Promise<long, (impala::PromiseMode)0>*),
boost::_bi::list5<boost::_bi::value<std::string>,
boost::_bi::value<std::string>, boost::_bi::value<boost::function<void ()> >,
boost::_bi::value<impala::ThreadDebugInfo*>,
boost::_bi::value<impala::Promise<long, (impala::PromiseMode)0>*> >
>::operator()() (this=0x13557db8) at
/var/lib/jenkins/impala/toolchain/boost-1.61.0-p2/include/boost/bind/bind.hpp:1222
#14 0x000000000259246a in boost::detail::thread_data<boost::_bi::bind_t<void,
void (*)(std::string const&, std::string const&, boost::function<void ()>,
impala::ThreadDebugInfo const*, impala::Promise<long,
(impala::PromiseMode)0>*), boost::_bi::list5<boost::_bi::value<std::string>,
boost::_bi::value<std::string>, boost::_bi::value<boost::function<void ()> >,
boost::_bi::value<impala::ThreadDebugInfo*>,
boost::_bi::value<impala::Promise<long, (impala::PromiseMode)0>*> > > >::run()
(this=0x13557c00) at
/var/lib/jenkins/impala/toolchain/boost-1.61.0-p2/include/boost/thread/detail/thread.hpp:116
#15 0x0000000003dc1cba in thread_proxy ()
#16 0x00007f28cd127e25 in start_thread () from /lib64/libpthread.so.0
#17 0x00007f28c9c8b34d in clone () from /lib64/libc.so.6{code}
However, in the master branch, it's another symptom: IMPALA-11344. We will fix
it separately.
> The executor has some resident threads that occupy CPU abnormally.
> ------------------------------------------------------------------
>
> Key: IMPALA-11296
> URL: https://issues.apache.org/jira/browse/IMPALA-11296
> Project: IMPALA
> Issue Type: Bug
> Affects Versions: Impala 3.4.0
> Reporter: zhi tang
> Assignee: zhi tang
> Priority: Major
> Attachments: image-2022-05-17-16-40-52-110.png, top_info.png
>
>
> The executor has some resident threads that occupy CPU abnormally. The
> following is the call stack information of a thread:
> !image-2022-05-17-16-40-52-110.png!
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
