[
https://issues.apache.org/jira/browse/IMPALA-13590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902229#comment-17902229
]
Zihao Ye commented on IMPALA-13590:
-----------------------------------
Additionally, in some special cases, CACHELINE_ALIGNED may cause crash issues.
Specifically, when we run binaries compiled on CentOS on the openEuler system,
executing queries with enabled Runtime Filter causes impalad to crash. The log
contains the following error:
{code:c}
src/tcmalloc.cc:283] Attempt to free invalid pointer 0x7f2a14000a00
{code}
The call stack is as follows:
{code:c}
Thread 661 (crashed)
0 libc.so.6 + 0x8d13f
1 libc.so.6 + 0x40e46
2 libc.so.6 + 0x2c1d7
3 impalad!tcmalloc::Log(tcmalloc::LogMode, char const*, int,
tcmalloc::LogItem, tcmalloc::LogItem, tcmalloc::LogItem, tcmalloc::LogItem) +
0x223
4 impalad!_fini + 0x124f04
5 impalad!cfree + 0x310
6 impalad!impala::RuntimeFilterBank::~RuntimeFilterBank() [unique_ptr.h : 78
+ 0x1f]
7 impalad!impala::QueryState::~QueryState() [unique_ptr.h : 78 + 0x8]
8 impalad!impala::QueryExecMgr::ReleaseQueryState(impala::QueryState*)
[query-exec-mgr.cc : 221 + 0x8]
9 impalad + 0x1680370
10 libc.so.6 + 0x8cf80
11 impalad!impala::QueryExecMgr::ExecuteQueryHelper(impala::QueryState*)
[query-exec-mgr.cc : 189 + 0xb]
{code}
Through gdb, it can be specifically located that the crash occurs when
destructing PerFilterState. If CACHELINE_ALIGNED is removed from PerFilterState
and then compiled and run under the same conditions, there is no crash.
> The CACHELINE_ALIGNED of PerFilterState may not work on dynamic allocations
> ---------------------------------------------------------------------------
>
> Key: IMPALA-13590
> URL: https://issues.apache.org/jira/browse/IMPALA-13590
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Affects Versions: Impala 4.4.1
> Reporter: Zihao Ye
> Assignee: Zihao Ye
> Priority: Major
>
> The PerFilterState class is marked with CACHELINE_ALIGNED:
> [https://github.com/apache/impala/blob/8416432cc3e656b6c5fa230d4075ba64e0f3d091/be/src/runtime/runtime-filter-bank.h#L300]
> And its creation is dynamic:
> [https://github.com/apache/impala/blob/8416432cc3e656b6c5fa230d4075ba64e0f3d091/be/src/runtime/runtime-filter-bank.cc#L116]
> According to this response, such a combination may be ineffective:
> [https://stackoverflow.com/questions/19251360/attribute-alignedx-doesnt-work-on-dynamic-allocations].
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
