[
https://issues.apache.org/jira/browse/IMPALA-8257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tim Armstrong updated IMPALA-8257:
----------------------------------
Description:
Encountered while doing a large insert into Parquet.
{code}
create table customer like tpcds_300_text.customer stored as parquetfile
insert overwrite table customer select * from tpcds_300_text.customer
{code}
{noformat}
F0227 01:34:53.052708 131295 parquet-column-stats.inline.h:213]
794c051ae3f3913c:71f00bc400000001] Check failed:
static_cast<void*>(prev_page_min_value_.ptr) !=
static_cast<void*>(cs->min_value_.ptr) (0 vs. 0)
*** Check failure stack trace: ***
@ 0x47ec7ec google::LogMessage::Fail()
@ 0x47ee091 google::LogMessage::SendToLog()
@ 0x47ec1c6 google::LogMessage::Flush()
@ 0x47ef78d google::LogMessageFatal::~LogMessageFatal()
@ 0x27e973c impala::ColumnStats<>::Merge()
@ 0x27e3c74
impala::HdfsParquetTableWriter::BaseColumnWriter::FinalizeCurrentPage()
@ 0x27ee65f
impala::HdfsParquetTableWriter::BaseColumnWriter::AppendRow()
@ 0x27e653b impala::HdfsParquetTableWriter::AppendRows()
@ 0x23177fc impala::HdfsTableSink::WriteRowsToPartition()
@ 0x231aeeb impala::HdfsTableSink::Send()
@ 0x1f53888 impala::FragmentInstanceState::ExecInternal()
@ 0x1f4fefa impala::FragmentInstanceState::Exec()
@ 0x1f63333 impala::QueryState::ExecFInstance()
@ 0x1f61615 _ZZN6impala10QueryState15StartFInstancesEvENKUlvE_clEv
@ 0x1f64774
_ZN5boost6detail8function26void_function_obj_invoker0IZN6impala10QueryState15StartFInstancesEvEUlvE_vE6invokeERNS1_15function_bufferE
@ 0x1d76b9f boost::function0<>::operator()()
@ 0x22245ee impala::Thread::SuperviseThread()
@ 0x222c972 boost::_bi::list5<>::operator()<>()
@ 0x222c896 boost::_bi::bind_t<>::operator()()
@ 0x222c859 boost::detail::thread_data<>::run()
@ 0x3716329 thread_proxy
@ 0x7fba207e8dd4 start_thread
@ 0x7fba20511eac __clone
{noformat}
This actually happened on multiple machines at almost exactly the same time:
{noformat}
Running on machine: vc1328.halxg.cloudera.com
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
F0227 01:34:53.025667 133025 parquet-column-stats.inline.h:213]
794c051ae3f3913c:71f00bc400000005] Check failed:
static_cast<void*>(prev_page_min_value_.ptr) !=
static_cast<void*>(cs->min_value_.ptr) (0 vs. 0)
...
F0227 01:34:53.025352 131082 parquet-column-stats.inline.h:213]
794c051ae3f3913c:71f00bc400000007] Check failed:
static_cast<void*>(prev_page_min_value_.ptr) !=
static_cast<void*>(cs->min_value_.ptr) (0 vs. 0)
{noformat}
was:
Encountered while doing a large insert into Parquet.
{code}
create table customer like tpcds_300_text.customer stored as parquetfile
insert overwrite table customer select * from tpcds_300_text.customer
{code}
{noformat}
F0227 01:34:53.052708 131295 parquet-column-stats.inline.h:213]
794c051ae3f3913c:71f00bc400000001] Check failed:
static_cast<void*>(prev_page_min_value_.ptr) !=
static_cast<void*>(cs->min_value_.ptr) (0 vs. 0)
*** Check failure stack trace: ***
@ 0x47ec7ec google::LogMessage::Fail()
@ 0x47ee091 google::LogMessage::SendToLog()
@ 0x47ec1c6 google::LogMessage::Flush()
@ 0x47ef78d google::LogMessageFatal::~LogMessageFatal()
@ 0x27e973c impala::ColumnStats<>::Merge()
@ 0x27e3c74
impala::HdfsParquetTableWriter::BaseColumnWriter::FinalizeCurrentPage()
@ 0x27ee65f
impala::HdfsParquetTableWriter::BaseColumnWriter::AppendRow()
@ 0x27e653b impala::HdfsParquetTableWriter::AppendRows()
@ 0x23177fc impala::HdfsTableSink::WriteRowsToPartition()
@ 0x231aeeb impala::HdfsTableSink::Send()
@ 0x1f53888 impala::FragmentInstanceState::ExecInternal()
@ 0x1f4fefa impala::FragmentInstanceState::Exec()
@ 0x1f63333 impala::QueryState::ExecFInstance()
@ 0x1f61615 _ZZN6impala10QueryState15StartFInstancesEvENKUlvE_clEv
@ 0x1f64774
_ZN5boost6detail8function26void_function_obj_invoker0IZN6impala10QueryState15StartFInstancesEvEUlvE_vE6invokeERNS1_15function_bufferE
@ 0x1d76b9f boost::function0<>::operator()()
@ 0x22245ee impala::Thread::SuperviseThread()
@ 0x222c972 boost::_bi::list5<>::operator()<>()
@ 0x222c896 boost::_bi::bind_t<>::operator()()
@ 0x222c859 boost::detail::thread_data<>::run()
@ 0x3716329 thread_proxy
@ 0x7fba207e8dd4 start_thread
@ 0x7fba20511eac __clone
{noformat}
> Check failed: static_cast<void*>(prev_page_min_value_.ptr) !=
> static_cast<void*>(cs->min_value_.ptr) when inserting into parquet
> --------------------------------------------------------------------------------------------------------------------------------
>
> Key: IMPALA-8257
> URL: https://issues.apache.org/jira/browse/IMPALA-8257
> Project: IMPALA
> Issue Type: Bug
> Reporter: Tim Armstrong
> Assignee: Tim Armstrong
> Priority: Blocker
> Labels: crash
>
> Encountered while doing a large insert into Parquet.
> {code}
> create table customer like tpcds_300_text.customer stored as parquetfile
> insert overwrite table customer select * from tpcds_300_text.customer
> {code}
> {noformat}
> F0227 01:34:53.052708 131295 parquet-column-stats.inline.h:213]
> 794c051ae3f3913c:71f00bc400000001] Check failed:
> static_cast<void*>(prev_page_min_value_.ptr) !=
> static_cast<void*>(cs->min_value_.ptr) (0 vs. 0)
> *** Check failure stack trace: ***
> @ 0x47ec7ec google::LogMessage::Fail()
> @ 0x47ee091 google::LogMessage::SendToLog()
> @ 0x47ec1c6 google::LogMessage::Flush()
> @ 0x47ef78d google::LogMessageFatal::~LogMessageFatal()
> @ 0x27e973c impala::ColumnStats<>::Merge()
> @ 0x27e3c74
> impala::HdfsParquetTableWriter::BaseColumnWriter::FinalizeCurrentPage()
> @ 0x27ee65f
> impala::HdfsParquetTableWriter::BaseColumnWriter::AppendRow()
> @ 0x27e653b impala::HdfsParquetTableWriter::AppendRows()
> @ 0x23177fc impala::HdfsTableSink::WriteRowsToPartition()
> @ 0x231aeeb impala::HdfsTableSink::Send()
> @ 0x1f53888 impala::FragmentInstanceState::ExecInternal()
> @ 0x1f4fefa impala::FragmentInstanceState::Exec()
> @ 0x1f63333 impala::QueryState::ExecFInstance()
> @ 0x1f61615
> _ZZN6impala10QueryState15StartFInstancesEvENKUlvE_clEv
> @ 0x1f64774
> _ZN5boost6detail8function26void_function_obj_invoker0IZN6impala10QueryState15StartFInstancesEvEUlvE_vE6invokeERNS1_15function_bufferE
> @ 0x1d76b9f boost::function0<>::operator()()
> @ 0x22245ee impala::Thread::SuperviseThread()
> @ 0x222c972 boost::_bi::list5<>::operator()<>()
> @ 0x222c896 boost::_bi::bind_t<>::operator()()
> @ 0x222c859 boost::detail::thread_data<>::run()
> @ 0x3716329 thread_proxy
> @ 0x7fba207e8dd4 start_thread
> @ 0x7fba20511eac __clone
> {noformat}
> This actually happened on multiple machines at almost exactly the same time:
> {noformat}
> Running on machine: vc1328.halxg.cloudera.com
> Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
> F0227 01:34:53.025667 133025 parquet-column-stats.inline.h:213]
> 794c051ae3f3913c:71f00bc400000005] Check failed:
> static_cast<void*>(prev_page_min_value_.ptr) !=
> static_cast<void*>(cs->min_value_.ptr) (0 vs. 0)
> ...
> F0227 01:34:53.025352 131082 parquet-column-stats.inline.h:213]
> 794c051ae3f3913c:71f00bc400000007] Check failed:
> static_cast<void*>(prev_page_min_value_.ptr) !=
> static_cast<void*>(cs->min_value_.ptr) (0 vs. 0)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
