[
https://issues.apache.org/jira/browse/IMPALA-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842400#comment-16842400
]
Todd Lipcon commented on IMPALA-8562:
-------------------------------------
Perhaps we should add a CHECK_GE(mtime, 0) to try to prevent these issues in
the future? If we just skip caching, then this bug will end up being
ineffective cache misses.
Another improvement possible here is to make use of HDFS "fileIds" which are
unique inode numbers
> Data cache should skip scan range with mtime == -1
> --------------------------------------------------
>
> Key: IMPALA-8562
> URL: https://issues.apache.org/jira/browse/IMPALA-8562
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Affects Versions: Impala 3.3.0
> Reporter: Michael Ho
> Assignee: Michael Ho
> Priority: Blocker
>
> As show in IMPALA-8561, using mtime == -1 as part of cache key may lead to
> reading stale data. Data cache should probably just skip caching those
> entries.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
