[
https://issues.apache.org/jira/browse/IMPALA-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tim Armstrong resolved IMPALA-6312.
-----------------------------------
Resolution: Cannot Reproduce
> Data load fails because of missing table
> ----------------------------------------
>
> Key: IMPALA-6312
> URL: https://issues.apache.org/jira/browse/IMPALA-6312
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 2.11.0
> Reporter: Pranay Singh
> Priority: Major
>
> Data load fails because of missing table
> impalad.INFO
> ---------------------------------------------------------------------
> I1211 20:53:33.089735 6212 Frontend.java:909] Compiling query: CREATE
> EXTERNAL TABLE IF NOT EXISTS functional_text_gzip.table_with_header (
> c1 int,
> c2 double
> )
> ROW FORMAT delimited fields terminated by ',' escaped by '\\'
> STORED AS TEXTFILE
> LOCATION '/test-warehouse/table_with_header_text_gzip'
> .
> .
> I1211 20:53:33.934106 6212 Frontend.java:909] Compiling query: ALTER TABLE
> table_with_header SET TBLPROPERTIES('skip.header.line.count'='1')
> I1211 20:53:33.934623 6212 Frontend.java:831] Requesting prioritized load of
> table(s): functional_text_gzip.table_with_header
> I1211 20:53:34.533540 6259 impala-beeswax-server.cc:52] query():
> query=CREATE EXTERNAL TABLE IF NOT EXISTS
> functional_parquet.widetable_1000_cols (
> .
> .
> I1211 20:53:36.961038 6212 Frontend.java:948] Compiled query.
> I1211 20:53:36.961956 6212 jni-util.cc:211]
> org.apache.impala.common.AnalysisException: Could not resolve table
> reference: 'table_with_header'
> at org.apache.impala.analysis.Analyzer.resolvePath(Analyzer.java:803)
> at org.apache.impala.analysis.Analyzer.resolvePath(Analyzer.java:756)
> at org.apache.impala.analysis.Analyzer.resolveTableRef(Analyzer.java:573)
> at org.apache.impala.analysis.AlterTableStmt.analyze(AlterTableStmt.java:73)
> at
> org.apache.impala.analysis.AlterTableSetStmt.analyze(AlterTableSetStmt.java:41)
> at
> org.apache.impala.analysis.AlterTableSetTblProperties.analyze(AlterTableSetTblProperties.java:84)
> at
> org.apache.impala.analysis.AnalysisContext.analyze(AnalysisContext.java:388)
> at
> org.apache.impala.analysis.AnalysisContext.analyze(AnalysisContext.java:369)
> at org.apache.impala.service.Frontend.analyzeStmt(Frontend.java:920)
> at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1069)
> at
> org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:156)
> I1211 20:53:36.966979 18064 impala-beeswax-server.cc:193]
> get_results_metadata(): query_id=df481c062572a1ed:6433f54300000000
> I1211 20:53:36.967836 18064 impala-server.cc:698] Query id
> df481c062572a1ed:6433f54300000000 not found.
> I1211 20:53:36.969046 18064 impala-beeswax-server.cc:235] close():
> query_id=df481c062572a1ed:6433f54300000000
> I1211 20:53:36.969056 18064 impala-server.cc:992] UnregisterQuery():
> query_id=df481c062572a1ed:6433f54300000000
> I1211 20:53:36.969065 18064 impala-server.cc:1075] Cancel():
> query_id=df481c062572a1ed:6433f54300000000
> I1211 20:53:36.970628 18064 impala-server.cc:1796] Connection from client
> 127.0.0.1:56278 closed, closing 1 associated session(s)
> I1211 20:53:36.978963 18075 impala-beeswax-server.cc:52] query():
> query=INSERT OVERWRITE TABLE tpch_parquet.lineitem SELECT * FROM tpch.lineitem
> I1211 20:53:36.979012 18075 impala-beeswax-server.cc:426] query: Query {
> 01: query (string) = "INSERT OVERWRITE TABLE tpch_parquet.lineitem SELECT *
> FROM tpch.lineitem"
> However, catalog shows that it has loaded the table_with_header
> catalogd.INFO
> --------------------
> I1211 20:53:33.935195 2283 TableLoadingMgr.java:70] Loading metadata for
> table: functional_text_gzip.table_with_header
> I1211 20:53:33.935276 28520 TableLoader.java:58] Loading metadata for:
> functional_text_gzip.table_with_header
> I1211 20:53:33.954375 28520 HdfsTable.java:1206] Fetching partition metadata
> from the Metastore: functional_text_gzip.table_with_header
> I1211 20:53:33.956279 28520 HdfsTable.java:1210] Fetched partition metadata
> from the Metastore: functional_text_gzip.table_with_header
> I1211 20:53:33.959602 28520 HdfsTable.java:834] Loading file and block
> metadata for 1 paths for table functional_text_gzip.table_with_header using a
> thread pool of size 1
> I1211 20:53:33.960515 28520 HdfsTable.java:874] Loaded file and block
> metadata for functional_text_gzip.table_with_header
> I1211 20:53:33.960593 28520 TableLoader.java:97] Loaded metadata for:
> functional_text_gzip.table_with_header
> I1211 20:53:35.642817 2331 catalog-server.cc:324] Publishing update:
> TABLE:functional_text_gzip.table_with_header@3711
> I1211 20:54:59.673141 2331 catalog-server.cc:324] Publishing update:
> TABLE:functional_text_gzip.table_with_header@4481
> I1211 21:07:41.841065 2331 catalog-server.cc:324] Publishing update:
> TABLE:functional_text_gzip.table_with_header@5414
> I1211 21:11:55.916780 2331 catalog-server.cc:324] Publishing update:
> TABLE:functional_text_gzip.table_with_header@6420
> Is it a race or delay in publishing the update that is causing issue here ?
> Details of the table being loaded that went missing
> -----------------------------------------------------------------------------------
> (load-functional-query-exhaustive-impala-generated-text-gzip-block.sql):
> CREATE EXTERNAL TABLE IF NOT EXISTS functional_text_gzip.table_with_header (
> c1 int,
> c2 double
> )
> ROW FORMAT delimited fields terminated by ',' escaped by '\\'
> STORED AS TEXTFILE
> LOCATION '/test-warehouse/table_with_header_text_gzip'
> Data Loading from Impala failed with error: ImpalaBeeswaxException:
> INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
> MESSAGE: AnalysisException: Could not resolve table reference:
> 'table_with_header'
> Traceback (most recent call last):
> File "Impala/bin/load-data.py", line 178, in exec_impala_query_from_file
> result = impala_client.execute(query)
> File "Impala/tests/beeswax/impala_beeswax.py", line 173, in execute
> handle = self.__execute_query(query_string.strip(), user=user)
> File "Impala/tests/beeswax/impala_beeswax.py", line 339, in __execute_query
> handle = self.execute_query_async(query_string, user=user)
> File Impala/tests/beeswax/impala_beeswax.py", line 335, in
> execute_query_async
> return self.__do_rpc(lambda: self.imp_service.query(query,))
> File "Impala/tests/beeswax/impala_beeswax.py", line 460, in __do_rpc
> raise ImpalaBeeswaxException(self.__build_error_message(b), b)
> ImpalaBeeswaxException: ImpalaBeeswaxException:
> INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
> MESSAGE: AnalysisException: Could not resolve table reference:
> 'table_with_header'
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
