[
https://issues.apache.org/jira/browse/IMPALA-10042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17170232#comment-17170232
]
Tim Armstrong commented on IMPALA-10042:
----------------------------------------
[~kishore_k] does "invalidate metadata <dbname.table_name>" help?
You could also help narrow down the issue by looking at the file size in "show
files in <tablename>" in Impala and comparing it to the file size in HDFS - it
will likely be different, which would explain why the version number - the last
few bytes in the file - doesn't match.
Would also be helpful to understand how that file was ingested, if files are
overwritten in-place there are more issues related to caching that are possible
(we've fixed all the known ones in later versions though). We had some related
issues due to IMPALA-8561
> ERROR: File has an invalid version number: This could be due to stale
> metadata. Try running "refresh <Table_name>".
> --------------------------------------------------------------------------------------------------------------------
>
> Key: IMPALA-10042
> URL: https://issues.apache.org/jira/browse/IMPALA-10042
> Project: IMPALA
> Issue Type: Bug
> Components: Backend, Catalog
> Affects Versions: Impala 3.2.0
> Reporter: kishorekumar kuruguntla
> Priority: Major
> Attachments: image-2020-08-03-10-31-37-405.png
>
>
> Hi,
> I am performing etl and loading Parquet table through Hive .
> Ran invalidate metadata <db_name.table_name> in impala.
> While trying to run "compute stats <db_name.table_name>" or running "Select
> count ( * ) from <db_name.table_name>" ,getting File has Invalid Version
> Number.
> *Full Error :*
> ERROR: File '<full_hdfs_path>' has an invalid version number: <Random_number>
> This could be due to stale metadata. Try running "refresh
> <db_name.table_name>".
>
> !image-2020-08-03-10-31-37-405.png!
>
> Tried running "refresh <db_name.table_name>" multiple times ,still "Select
> count ( * )" or "Compute stats " not working.
> I am able to run "Select count ( * ) from <db_name.table_name> " in hive
> beeline successfully ,but in impala it is not working.
>
> Seems like this issue is fixed in
> https://issues.apache.org/jira/browse/IMPALA-2477 ( impala 2.3.0 ).
> But still we are facing this issue in *version 3.2.0-cdh6.2.1*
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
