Joe McDonnell created IMPALA-11010:
--------------------------------------
Summary: After waiting in admission control, query fails with
FileNotFoundException
Key: IMPALA-11010
URL: https://issues.apache.org/jira/browse/IMPALA-11010
Project: IMPALA
Issue Type: Bug
Components: Backend
Affects Versions: Impala 4.0.0
Reporter: Joe McDonnell
A cluster ran into this scenario:
# A query against table X was submitted
# It waited in admission control for over 10 minutes
# By the time it was admitted, table X had been modified, removing some files
# The query fails with FileNotFoundException
It looks like the core issue could be that the metadata is from before
admission and it becomes stale over time. This could start to be a problem for
tables that have a faster update rate.
There are lots of ways to alleviate this (add nodes, query retries, etc), but
it probably makes sense to think about whether there is some way to be smarter
about the metadata as well.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
