[
https://issues.apache.org/jira/browse/IMPALA-11296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17552838#comment-17552838
]
ASF subversion and git services commented on IMPALA-11296:
----------------------------------------------------------
Commit 1de16355eea1ab3f6eb93472dbfa40cd37de39a4 in impala's branch
refs/heads/3.x from ttttttz
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=1de16355e ]
IMPALA-11296: Fix infinite loop when reading orc files
When querying an ORC table, selecting only the missing fields of ORC
files causes the query to be executed indefinitely. The
corresponding execution node will see some resident threads that
occupy CPU abnormally. The problem is caused by this:
when OrcComplexColumnReader.children_.empty() is true,
OrcComplexColumnReader.row_idx_ will remain constant, causing an
infinite loop at HdfsOrcScanner::TransferTuples().
We should allow empty 'children_' for original files.
Testing:
- Added a test to test_scanners.py that ensures the query can be
executed successfully when selecting only the missing fields of
ORC files.
Change-Id: Ic7ecf5e9c94ffcc02d3ca6c2ec8d55a685ec3968
Reviewed-on: http://gerrit.cloudera.org:8080/18571
Reviewed-by: Quanlong Huang <[email protected]>
Reviewed-by: Zoltan Borok-Nagy <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> The executor has some resident threads that occupy CPU abnormally.
> ------------------------------------------------------------------
>
> Key: IMPALA-11296
> URL: https://issues.apache.org/jira/browse/IMPALA-11296
> Project: IMPALA
> Issue Type: Bug
> Affects Versions: Impala 3.4.0
> Reporter: zhi tang
> Assignee: zhi tang
> Priority: Major
> Attachments: image-2022-05-17-16-40-52-110.png, top_info.png
>
>
> The executor has some resident threads that occupy CPU abnormally. The
> following is the call stack information of a thread:
> !image-2022-05-17-16-40-52-110.png!
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
