Wenzhe Zhou created IMPALA-12617:
------------------------------------
Summary: Statestore hit DCHECK failure in ThreadPool::Offer()
Key: IMPALA-12617
URL: https://issues.apache.org/jira/browse/IMPALA-12617
Project: IMPALA
Issue Type: Bug
Components: Backend
Reporter: Wenzhe Zhou
Assignee: Wenzhe Zhou
Statestore hit DCHECK failure in ThreadPool::Offer() when ran
custom_cluster/test_statestored_ha.py::TestStatestoredHA::test_statestored_manual_failover
in GVO with following stack:
{code:java}
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
E1210 22:03:20.429834 2103817 logging.cc:256] stderr will be logged to this
file.
F1210 22:03:20.438897 2103854 thread-pool.h:103] Check failed: initialized_
*** Check failure stack trace: ***
@ 0x38e9c5d google::LogMessage::Fail()
@ 0x38ebb94 google::LogMessage::SendToLog()
@ 0x38e963c google::LogMessage::Flush()
@ 0x38ec0b9 google::LogMessageFatal::~LogMessageFatal()
@ 0x18137f9 impala::Statestore::OfferUpdate()
@ 0x1814c91 impala::Statestore::RegisterSubscriber()
@ 0x1844606 StatestoreThriftIf::RegisterSubscriber()
@ 0x184278e
impala::StatestoreServiceProcessorT<>::process_RegisterSubscriber()
@ 0x18457fd impala::StatestoreServiceProcessorT<>::dispatchCall()
@ 0xf1cd25 apache::thrift::TDispatchProcessor::process()
@ 0x13723a2
apache::thrift::server::TAcceptQueueServer::Task::run()
@ 0x135ee3d impala::ThriftThread::RunRunnable()
@ 0x1360a65
boost::detail::function::void_function_obj_invoker0<>::invoke()
@ 0x19bbe58 impala::Thread::SuperviseThread()
@ 0x19bcc61 boost::detail::thread_data<>::run()
@ 0x240bb67 thread_proxy
@ 0x7f24994b1609 start_thread
@ 0x7f24974cc133 clone
{code}
statestore uses thread pools to periodically send catalog topic update and
cluster membership. It adds sending tasks to the queues of thread pools when
receiving registration requests from subscribers so the thread pools have to be
ready before the Thrift server of statestore is started to accept registration
request.
Current code call ThreadPool::Init() after the Thrift server is started. This
could cause statestore to hit DCHECK failure in ThreadPool::Offer().
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
