[
https://issues.apache.org/jira/browse/IMPALA-10040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17170228#comment-17170228
]
Tim Armstrong commented on IMPALA-10040:
----------------------------------------
I think that's probably a reasonable solution, I don't think the capacity check
would add much overhead in that loop.
The memory capacity is a soft limit, so it would also be OK to loosen the
DCHECK so that it's only checking the hard limit on rows in the batch.
DCHECK_LT(dst_batch->num_rows(), dst_batch->capacity())
> Crash on UnionNode when codegen is disabled
> -------------------------------------------
>
> Key: IMPALA-10040
> URL: https://issues.apache.org/jira/browse/IMPALA-10040
> Project: IMPALA
> Issue Type: Bug
> Reporter: Quanlong Huang
> Priority: Critical
>
> Saw a crash when ran a UNION query with codegen disabled:
> {code}
> F0803 15:37:44.551749 24805 union-node-ir.cc:26]
> fd41196430b5c449:0a195a2500000006] Check failed: !dst_batch->AtCapacity()
> *** Check failure stack trace: ***
> @ 0x514aa8c google::LogMessage::Fail()
> @ 0x514c37c google::LogMessage::SendToLog()
> @ 0x514a3ea google::LogMessage::Flush()
> @ 0x514dfe8 google::LogMessageFatal::~LogMessageFatal()
> @ 0x286c323 impala::UnionNode::MaterializeExprs()
> @ 0x286c983 impala::UnionNode::MaterializeBatch()
> @ 0x286798a impala::UnionNode::GetNextMaterialized()
> @ 0x2868ac4 impala::UnionNode::GetNext()
> @ 0x225f77c impala::FragmentInstanceState::ExecInternal()
> @ 0x225be20 impala::FragmentInstanceState::Exec()
> @ 0x2285c35 impala::QueryState::ExecFInstance()
> @ 0x2284037
> _ZZN6impala10QueryState15StartFInstancesEvENKUlvE_clEv
> @ 0x22877d6
> _ZN5boost6detail8function26void_function_obj_invoker0IZN6impala10QueryState15StartFInstancesEvEUlvE_vE6invokeERNS1_15function_bufferE
> @ 0x2053061 boost::function0<>::operator()()
> @ 0x2676bff impala::Thread::SuperviseThread()
> @ 0x267eb9c boost::_bi::list5<>::operator()<>()
> @ 0x267eac0 boost::_bi::bind_t<>::operator()()
> @ 0x267ea81 boost::detail::thread_data<>::run()
> @ 0x3e514e1 thread_proxy
> @ 0x7f6575c326b9 start_thread
> @ 0x7f65727fe4dc clone
> {code}
> The query is
> {code}
> I0803 15:37:44.273838 24616 Frontend.java:1508]
> fd41196430b5c449:0a195a2500000000] Analyzing query: create table my_bigstrs
> stored as parquet as
> select *, repeat(string_col, 100000) as bigstr
> from functional.alltypes
> order by id
> limit 10
> union all
> select *, repeat(string_col, 10000000) as bigstr
> from functional.alltypes
> order by id
> limit 10 db: default
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
