Tim Armstrong has posted comments on this change. (
http://gerrit.cloudera.org:8080/8936 )
Change subject: IMPALA-3833: Fix invalid data handling in Sequence and RCFile
scanners
......................................................................
Patch Set 3:
I hit a DCHECK after running this in a loop for a couple minutes.
F0118 11:53:48.126408 11019 scanner-context.inline.h:97] Check failed:
bytes_left > 0 (-197 vs. 0)
*** Check failure stack trace: ***
@ 0x3c0541d google::LogMessage::Fail()
@ 0x3c06cc2 google::LogMessage::SendToLog()
@ 0x3c04df7 google::LogMessage::Flush()
@ 0x3c083be google::LogMessageFatal::~LogMessageFatal()
@ 0x1bc5c8b impala::ScannerContext::Stream::SkipBytes()
@ 0x1bc320a impala::HdfsRCFileScanner::ReadColumnBuffers()
@ 0x1bc1a71 impala::HdfsRCFileScanner::StartRowGroup()
@ 0x1bc38ba impala::HdfsRCFileScanner::ProcessRange()
@ 0x293ecaa impala::BaseSequenceScanner::GetNextInternal()
@ 0x1ba2ede impala::HdfsScanner::ProcessSplit()
@ 0x1b7b1b4 impala::HdfsScanNode::ProcessSplit()
@ 0x1b7a5df impala::HdfsScanNode::ScannerThread()
@ 0x1b79a62
_ZZN6impala12HdfsScanNode22ThreadTokenAvailableCbEPNS_17ThreadResourceMgr12ResourcePoolEENKUlvE_clEv
@ 0x1b7ba05
_ZN5boost6detail8function26void_function_obj_invoker0IZN6impala12HdfsScanNode22ThreadTokenAvailableCbEPNS3_17ThreadResourceMgr12ResourcePoolEEUlvE_vE6invokeERNS1_15function_bufferE
@ 0x17d6bda boost::function0<>::operator()()
@ 0x1ad0bf7 impala::Thread::SuperviseThread()
@ 0x1ad990c boost::_bi::list4<>::operator()<>()
@ 0x1ad984f boost::_bi::bind_t<>::operator()()
@ 0x1ad9812 boost::detail::thread_data<>::run()
@ 0x2d8edba thread_proxy
@ 0x7f4c344426ba start_thread
@ 0x7f4c341783dd clone
Picked up JAVA_TOOL_OPTIONS:
-agentlib:jdwp=transport=dt_socket,address=30000,server=y,suspend=n
Wrote minidump to
/home/tarmstrong/Impala/incubator-impala/logs/cluster/minidumps/impalad/aadeb6a5-be5b-4a86-c5991d87-fa93553b.dmp
--
To view, visit http://gerrit.cloudera.org:8080/8936
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ic9cfc38af3f30c65ada9734eb471dbfa6ecdd74a
Gerrit-Change-Number: 8936
Gerrit-PatchSet: 3
Gerrit-Owner: Pranay Singh
Gerrit-Reviewer: Pranay Singh
Gerrit-Reviewer: Tim Armstrong <[email protected]>
Gerrit-Reviewer: anujphadke <[email protected]>
Gerrit-Comment-Date: Thu, 18 Jan 2018 19:55:33 +0000
Gerrit-HasComments: No
