[
https://issues.apache.org/jira/browse/IMPALA-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17217250#comment-17217250
]
ASF subversion and git services commented on IMPALA-9918:
---------------------------------------------------------
Commit 1e2176c84909a26e6405df7ae6d34d724e5a5217 in impala's branch
refs/heads/master from Csaba Ringhofer
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=1e2176c ]
IMPALA-9918: ORC scanner hits DCHECK when GLOG_v=3
PrintPath assumed that all elements in the path are complex,
and hit a DCHECK if it contained a scalar element. This didn't
seem to cause problems in Parquet, but the ORC scanner called
this function with paths where the last element was scalar.
This problem was probably not discovered because no one tested
ORC scanning with v=3 logging + DEBUG builds.
Also added logging to the events when log levels are changed
through the webpage. In case of ResetJavaLogLevelCallback
there was already log line from GlogAppender.java.
Note that the cause of the original issue is still unknown,
as it occurred during custom cluster tests where no other tests
should change the log levels in parallel.
Testing:
- tested the log changes manually
Change-Id: I94e12d2a62ccab5eb5d21675d5f0138f04e622ac
Reviewed-on: http://gerrit.cloudera.org:8080/16611
Reviewed-by: Tim Armstrong <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> HdfsOrcScanner crash on resolving columns
> -----------------------------------------
>
> Key: IMPALA-9918
> URL: https://issues.apache.org/jira/browse/IMPALA-9918
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Affects Versions: Impala 4.0
> Environment: BUILD_TAG
> jenkins-impala-cdpd-master-core-ubsan-111
> Reporter: Wenzhe Zhou
> Assignee: Csaba Ringhofer
> Priority: Major
> Labels: broken-build
> Attachments: 092420_backtraces.txt, backtraces.txt, backtraces.txt
>
>
> Core file generated in impala-cdpd-master-core-ubsan build
> Back traces:
> CORE: ./tests/core.1594000709.13971.impalad
> BINARY: ./be/build/latest/service/impalad
> Core was generated by
> `/data/jenkins/workspace/impala-cdpd-master-core-ubsan/repos/Impala/be/build/lat'.
> Program terminated with signal SIGABRT, Aborted.
> #0 0x00007f7a481851f7 in raise () from /lib64/libc.so.6
> To enable execution of this file add
> add-auto-load-safe-path
> /data0/jenkins/workspace/impala-cdpd-master-core-ubsan/Impala-Toolchain/gcc-4.9.2/lib64/libstdc++.so.6.0.20-gdb.py
> line to your configuration file "/var/lib/jenkins/.gdbinit".
> To completely disable this security protection add
> set auto-load safe-path /
> line to your configuration file "/var/lib/jenkins/.gdbinit".
> For more information about this security protection see the
> "Auto-loading safe path" section in the GDB manual. E.g., run from the shell:
> info "(gdb)Auto-loading safe path"
> #0 0x00007f7a481851f7 in raise () from /lib64/libc.so.6
> #1 0x00007f7a481868e8 in abort () from /lib64/libc.so.6
> #2 0x00000000083401c4 in google::DumpStackTraceAndExit() ()
> #3 0x0000000008336b5d in google::LogMessage::Fail() ()
> #4 0x0000000008338402 in google::LogMessage::SendToLog() ()
> #5 0x0000000008336537 in google::LogMessage::Flush() ()
> #6 0x0000000008339afe in google::LogMessageFatal::~LogMessageFatal() ()
> #7 0x0000000003215662 in impala::PrintPath (tbl_desc=..., path=...) at
> /data/jenkins/workspace/impala-cdpd-master-core-ubsan/repos/Impala/be/src/util/debug-util.cc:259
> #8 0x000000000370dfe9 in impala::HdfsOrcScanner::ResolveColumns
> (this=0x14555c00, tuple_desc=..., selected_nodes=0x7f79722730a8,
> pos_slots=0x7f7972273058) at
> /data/jenkins/workspace/impala-cdpd-master-core-ubsan/repos/Impala/be/src/exec/hdfs-orc-scanner.cc:436
> #9 0x00000000037099dd in impala::HdfsOrcScanner::SelectColumns
> (this=0x14555c00, tuple_desc=...) at
> /data/jenkins/workspace/impala-cdpd-master-core-ubsan/repos/Impala/be/src/exec/hdfs-orc-scanner.cc:456
> #10 0x0000000003707688 in impala::HdfsOrcScanner::Open (this=0x14555c00,
> context=0x7f7972274700) at
> /data/jenkins/workspace/impala-cdpd-master-core-ubsan/repos/Impala/be/src/exec/hdfs-orc-scanner.cc:221
> #11 0x00000000035e0a48 in
> impala::HdfsScanNodeBase::CreateAndOpenScannerHelper (this=0x1b1c7100,
> partition=0x142f9d00, context=0x7f7972274700, scanner=0x7f79722746f8) at
> /data/jenkins/workspace/impala-cdpd-master-core-ubsan/repos/Impala/be/src/exec/hdfs-scan-node-base.cc:882
> #12 0x00000000039df2e8 in impala::HdfsScanNode::ProcessSplit
> (this=0x1b1c7100, filter_ctxs=..., expr_results_pool=0x7f7972274bd8,
> scan_range=0x12a16c40, scanner_thread_reservation=0x7f7972274e18) at
> /data/jenkins/workspace/impala-cdpd-master-core-ubsan/repos/Impala/be/src/exec/hdfs-scan-node.cc:480
> #13 0x00000000039ddd85 in impala::HdfsScanNode::ScannerThread
> (this=0x1b1c7100, first_thread=true, scanner_thread_reservation=8192) at
> /data/jenkins/workspace/impala-cdpd-master-core-ubsan/repos/Impala/be/src/exec/hdfs-scan-node.cc:418
> #14 0x00000000039e1980 in
> impala::HdfsScanNode::ThreadTokenAvailableCb(impala::ThreadResourcePool*)::$_0::operator()()
> const (this=0x7f7972275450) at
> /data/jenkins/workspace/impala-cdpd-master-core-ubsan/repos/Impala/be/src/exec/hdfs-scan-node.cc:339
> #15 0x00000000039e13b2 in
> boost::detail::function::void_function_obj_invoker0<impala::HdfsScanNode::ThreadTokenAvailableCb(impala::ThreadResourcePool*)::$_0,
> void>::invoke(boost::detail::function::function_buffer&)
> (function_obj_ptr=...) at
> /data/jenkins/workspace/impala-cdpd-master-core-ubsan/Impala-Toolchain/boost-1.61.0-p2/include/boost/function/function_template.hpp:159
> #16 0x00000000024d46f0 in boost::function0<void>::operator()
> (this=0x7f7972275448) at
> /data/jenkins/workspace/impala-cdpd-master-core-ubsan/Impala-Toolchain/boost-1.61.0-p2/include/boost/function/function_template.hpp:770
> #17 0x0000000003425ba7 in impala::Thread::SuperviseThread(std::string const&,
> std::string const&, boost::function<void ()>, impala::ThreadDebugInfo const*,
> impala::Promise<long, (impala::PromiseMode)0>*) (name=..., category=...,
> functor=..., parent_thread_info=0x7f797006d068,
> thread_started=0x7f797006a5e0) at
> /data/jenkins/workspace/impala-cdpd-master-core-ubsan/repos/Impala/be/src/util/thread.cc:360
> #18 0x0000000003438b87 in boost::_bi::list5<boost::_bi::value<std::string>,
> boost::_bi::value<std::string>, boost::_bi::value<boost::function<void ()> >,
> boost::_bi::value<impala::ThreadDebugInfo*>,
> boost::_bi::value<impala::Promise<long, (impala::PromiseMode)0>*>
> >::operator()<void (*)(std::string const&, std::string const&,
> boost::function<void ()>, impala::ThreadDebugInfo const*,
> impala::Promise<long, (impala::PromiseMode)0>*),
> boost::_bi::list0>(boost::_bi::type<void>, void (*&)(std::string const&,
> std::string const&, boost::function<void ()>, impala::ThreadDebugInfo const*,
> impala::Promise<long, (impala::PromiseMode)0>*), boost::_bi::list0&, int)
> (this=0x149c0fc0, f=@0x149c0fb8: 0x3425650
> <impala::Thread::SuperviseThread(std::string const&, std::string const&,
> boost::function<void ()>, impala::ThreadDebugInfo const*,
> impala::Promise<long, (impala::PromiseMode)0>*)>, a=...) at
> /data/jenkins/workspace/impala-cdpd-master-core-ubsan/Impala-Toolchain/boost-1.61.0-p2/include/boost/bind/bind.hpp:531
> #19 0x00000000034387a7 in boost::_bi::bind_t<void, void (*)(std::string
> const&, std::string const&, boost::function<void ()>, impala::ThreadDebugInfo
> const*, impala::Promise<long, (impala::PromiseMode)0>*),
> boost::_bi::list5<boost::_bi::value<std::string>,
> boost::_bi::value<std::string>, boost::_bi::value<boost::function<void ()> >,
> boost::_bi::value<impala::ThreadDebugInfo*>,
> boost::_bi::value<impala::Promise<long, (impala::PromiseMode)0>*> >
> >::operator()() (this=0x149c0fb8) at
> /data/jenkins/workspace/impala-cdpd-master-core-ubsan/Impala-Toolchain/boost-1.61.0-p2/include/boost/bind/bind.hpp:1222
> #20 0x0000000003437f85 in boost::detail::thread_data<boost::_bi::bind_t<void,
> void (*)(std::string const&, std::string const&, boost::function<void ()>,
> impala::ThreadDebugInfo const*, impala::Promise<long,
> (impala::PromiseMode)0>*), boost::_bi::list5<boost::_bi::value<std::string>,
> boost::_bi::value<std::string>, boost::_bi::value<boost::function<void ()> >,
> boost::_bi::value<impala::ThreadDebugInfo*>,
> boost::_bi::value<impala::Promise<long, (impala::PromiseMode)0>*> > >
> >::run() (this=0x149c0e00) at
> /data/jenkins/workspace/impala-cdpd-master-core-ubsan/Impala-Toolchain/boost-1.61.0-p2/include/boost/thread/detail/thread.hpp:116
> #21 0x00000000072080fa in thread_proxy ()
> #22 0x00007f7a4b4e2e25 in start_thread () from /lib64/libpthread.so.0
> #23 0x00007f7a4824834d in clone () from /lib64/libc.so.6
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
