[
https://issues.apache.org/jira/browse/IMPALA-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16754399#comment-16754399
]
Philip Zeyliger commented on IMPALA-8120:
-----------------------------------------
As Joe mentioned, this smells a lot like IMPALA-8091.
> Build Failure: Undetermined data load error for tpcds for Kudu
> --------------------------------------------------------------
>
> Key: IMPALA-8120
> URL: https://issues.apache.org/jira/browse/IMPALA-8120
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 3.1.0
> Reporter: Paul Rogers
> Assignee: Lenisha Gandhi
> Priority: Blocker
> Labels: build-failure
> Fix For: Impala 3.1.0
>
>
> The build for the latest master failed with an unspecified error when loading
> data:
> {noformat}
> 03:07:58 Loading TPC-DS data (logging to
> /data/jenkins/workspace/impala-cdh6.x-exhaustive-release/repos/Impala/logs/data_loading/load-tpcds.log)...
>
> 03:07:58 + echo 'Log for command '\''load-data' tpcds 'core'\'''
> 03:07:58 + START_TIME=38
> 03:07:58 + load-data tpcds core
> 03:11:31 + ELAPSED_TIME=213
> 03:11:31 + echo ' FAILED (Took: 3 min 33 sec)'
> 03:11:31 FAILED (Took: 3 min 33 sec)
> {noformat}
> Also:
> {noformat}
> 03:17:43 + echo ' Loading workload '\''tpcds'\'' using exploration strategy
> '\''core'\'' OK (Took: 9 min 45 sec)'
> 03:17:43 Loading workload 'tpcds' using exploration strategy 'core' OK
> (Took: 9 min 45 sec)
> 03:19:39 + ELAPSED_TIME=701
> 03:19:39 + echo ' FAILED (Took: 11 min 41 sec)'
> 03:19:39 FAILED (Took: 11 min 41 sec)
> 03:19:39 + echo ' '\''load-data' functional-query 'exhaustive'\'' failed.
> Tail of log:'
> {noformat}
> Tail of log:
> {noformat}
> 03:19:39 03:19:39 Error executing impala SQL:
> /data/jenkins/workspace/impala-cdh6.x-exhaustive-release/repos/Impala/logs/data_loading/sql/functional/create-functional-query-exhaustive-impala-generated-kudu-none-none.sql
> See:
> /data/jenkins/workspace/impala-cdh6.x-exhaustive-release/repos/Impala/logs/data_loading/sql/functional/create-functional-query-exhaustive-impala-generated-kudu-none-none.sql.log
> ...
> 03:19:39 ++ report_build_error 85
> 03:19:39 +++ cd
> /data/jenkins/workspace/impala-cdh6.x-exhaustive-release/repos/Impala
> 03:19:39 +++ awk 'NR == 85'
> /data/jenkins/workspace/impala-cdh6.x-exhaustive-release/repos/Impala/testdata/bin/create-load-data.sh
> 03:19:39 ++ ERROR_MSG=' -cm_host)'
> 03:19:39 +++ basename --
> /data/jenkins/workspace/impala-cdh6.x-exhaustive-release/repos/Impala/testdata/bin/create-load-data.sh
> 03:19:39 ++ FILENAME=create-load-data.sh
> 03:19:39 ++ echo ERROR in
> /data/jenkins/workspace/impala-cdh6.x-exhaustive-release/repos/Impala/testdata/bin/create-load-data.sh
> at line 85: '-cm_host)'
> ...
> 03:19:39 + [[ RELEASE = \A\S\A\N ]]
> {noformat}
> From the catalogd log:
> {noformat}
> I0125 03:11:31.808512 9906 jni-util.cc:256]
> org.apache.impala.common.ImpalaRuntimeException: Error creating Kudu table
> 'impala::tpch_kudu.lineitem'
> at
> org.apache.impala.service.KuduCatalogOpExecutor.createManagedTable(KuduCatalogOpExecutor.java:94)
> at
> org.apache.impala.service.CatalogOpExecutor.createKuduTable(CatalogOpExecutor.java:1768)
> at
> org.apache.impala.service.CatalogOpExecutor.createTable(CatalogOpExecutor.java:1686)
> at
> org.apache.impala.service.CatalogOpExecutor.execDdlRequest(CatalogOpExecutor.java:287)
> at org.apache.impala.service.JniCatalog.execDdl(JniCatalog.java:154)
> Caused by: org.apache.kudu.client.NonRecoverableException: can not complete
> before timeout: KuduRpc(method=ListTables, tablet=null, attempt=95,
> DeadlineTracker(timeout=180000, elapsed=178163), Traces: [0ms] querying
> master, [41ms] Sub rpc: ConnectToMaster sending RPC to server
> master-localhost:7051, [91ms] Sub rpc: ConnectToMaster received from server
> master-localhost:7051 response Network error: java.net.ConnectException:
> Connection refused: localhost/127.0.0.1:7051, [98ms] delaying RPC due to
> Service unavailable: Master config (localhost:7051) has no leader. Exceptions
> received: org.apache.kudu.client.RecoverableException:
> java.net.ConnectException: Connection refused: localhost/127.0.0.1:7051,
> [118ms] querying master, [121ms] Sub rpc: ConnectToMaster sending RPC to
> server master-localhost:7051, [122ms] Sub rpc: ConnectToMaster received from
> server master-localhost:7051 response Network error:
> java.net.ConnectException: Connection refused: localhost/127.0.0.1:7051,
> [122ms] delaying RPC due to Service unavailable: Master config
> (localhost:7051) has no leader. Exceptions received:
> org.apache.kudu.client.RecoverableException: java.net.ConnectException:
> Connection refused: localhost/127.0.0.1:7051, [138ms] querying master,
> [138ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051,
> [139ms] Sub rpc: ConnectToMaster received from server master-localhost:7051
> response Network error: java.net.ConnectException: Connection refused:
> localhost/127.0.0.1:7051, [140ms] delaying RPC due to Service unavailable:
> Master config (localhost:7051) has no leader. Exceptions received:
> org.apache.kudu.client.RecoverableException: java.net.ConnectException:
> Connection refused: localhost/127.0.0.1:7051, [159ms] querying master,
> [159ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051,
> [160ms] Sub rpc: ConnectToMaster received from server master-localhost:7051
> response Network error: java.net.ConnectException: Connection refused:
> localhost/127.0.0.1:7051, [161ms] delaying RPC due to Service unavailable:
> Master config (localhost:7051) has no leader. Exceptions received:
> org.apache.kudu.client.RecoverableException: java.net.ConnectException:
> Connection refused: localhost/127.0.0.1:7051, [178ms] querying master,
> [178ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051,
> [179ms] Sub rpc: ConnectToMaster received from server master-localhost:7051
> response Network error: java.net.ConnectException: Connection refused:
> localhost/127.0.0.1:7051, [180ms] delaying RPC due to Service unavailable:
> Master config (localhost:7051) has no leader. Exceptions received:
> org.apache.kudu.client.RecoverableException: java.net.ConnectException:
> Connection refused: localhost/127.0.0.1:7051, [219ms] querying master,
> [219ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051,
> [220ms] Sub rpc: ConnectToMaster received from server master-localhost:7051
> response Network error: java.net.ConnectException: Connection refused:
> localhost/127.0.0.1:7051, [220ms] delaying RPC due to Service unavailable:
> Master config (localhost:7051) has no leader. Exceptions received:
> org.apache.kudu.client.RecoverableException: java.net.ConnectException:
> Connection refused: localhost/127.0.0.1:7051, [258ms] querying master,
> [258ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051,
> [259ms] Sub rpc: ConnectToMaster received from server master-localhost:7051
> response Network error: java.net.ConnectException: Connection refused:
> localhost/127.0.0.1:7051, [260ms] delaying RPC due to Service unavailable:
> Master config (localhost:7051) has no leader. Exceptions received:
> org.apache.kudu.client.RecoverableException: java.net.ConnectException:
> Connection refused: localhost/127.0.0.1:7051, [319ms] querying master,
> [319ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051,
> [320ms] Sub rpc: ConnectToMaster received from server master-localhost:7051
> response Network error: java.net.ConnectException: Connection refused:
> localhost/127.0.0.1:7051, [320ms] delaying RPC due to Service unavailable:
> Master config (localhost:7051) has no leader. Exceptions received:
> org.apache.kudu.client.RecoverableException: java.net.ConnectException:
> Connection refused: localhost/127.0.0.1:7051, [358ms] querying master,
> [358ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051,
> [359ms] Sub rpc: ConnectToMaster received from server master-localhost:7051
> response Network error: java.net.ConnectException: Connection refused:
> localhost/127.0.0.1:7051, [360ms] delaying RPC due to Service unavailable:
> Master config (localhost:7051) has no leader. Exceptions received:
> org.apache.kudu.client.RecoverableException: java.net.ConnectException:
> Connection refused: localhost/127.0.0.1:7051, [879ms] querying master,
> [879ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051,
> [880ms] Sub rpc: ConnectToMaster received from server master-localhost:7051
> response Network error: java.net.ConnectException: Connection refused:
> localhost/127.0.0.1:7051, [881ms] delaying RPC due to Service unavailable:
> Master config (localhost:7051) has no leader. Exceptions received:
> org.apache.kudu.client.RecoverableException: java.net.ConnectException:
> Connection refused: localhost/127.0.0.1:7051, [1278ms] querying master,
> [1278ms] Sub rpc: ConnectToMaster sending RPC to server
> master-localhost:7051, [1279ms] Sub rpc: ConnectToMaster received from server
> master-localhost:7051 response Network error: java.net.ConnectException:
> Connection refused: localhost/127.0.0.1:7051, [1280ms] delaying RPC due to
> Service unavailable: Master config (localhost:7051) has no leader. Exceptions
> received: org.apache.kudu.client.RecoverableException:
> java.net.ConnectException: Connection refused: localhost/127.0.0.1:7051,
> [2139ms] querying master, [2139ms] Sub rpc: ConnectToMaster sending RPC to
> server master-localhost:7051, [2140ms] Sub rpc: ConnectToMaster received from
> server master-localhost:7051 response Network error:
> java.net.ConnectException: Connection refused: localhost/127.0.0.1:7051,
> [2141ms] delaying RPC due to Service unavailable: Master config
> (localhost:7051) has no leader. Exceptions received:
> org.apache.kudu.client.RecoverableException: java.net.ConnectException:
> Connection refused: localhost/127.0.0.1:7051, [5058ms] querying master,
> [5059ms] Sub rpc: ConnectToMaster sending RPC to server
> master-localhost:7051, [5060ms] Sub rpc: ConnectToMaster received from server
> master-localhost:7051 response Network error: java.net.ConnectException:
> Connection refused: localhost/127.0.0.1:7051, [5060ms] delaying RPC due to
> Service unavailable: Master config (localhost:7051) has no leader. Exceptions
> received: org.apache.kudu.client.RecoverableException:
> java.net.ConnectException: Connection refused: localhost/127.0.0.1:7051,
> [8239ms] querying master, [8239ms] Sub rpc: ConnectToMaster sending RPC to
> server master-localhost:7051, [8240ms] Sub rpc: ConnectToMaster received from
> server master-localhost:7051 response Network error:
> java.net.ConnectException: Connection refused: localhost/127.0.0.1:7051,
> [8241ms] delaying RPC due to Service unavailable: Master config
> (localhost:7051) has no leader. Exceptions received:
> org.apache.kudu.client.RecoverableException: java.net.ConnectException:
> Connection refused: localhost/127.0.0.1:7051, [11539ms] querying master,
> [11539ms] Sub rpc: ConnectToMaster sending RPC to server
> master-localhost:7051, [11540ms] Sub rpc: ConnectToMaster received from
> server master-localhost:7051 response Network error:
> java.net.ConnectException: Connection refused: localhost/127.0.0.1:7051,
> [11540ms] delaying RPC due to Service unavailable: Master config
> (localhost:7051) has no leader. Exceptions received:
> org.apache.kudu.client.RecoverableException: java.net.ConnectException:
> Connection refused: localhost/127.0.0.1:7051, [13258ms] querying master,
> [13259ms] Sub rpc: ConnectToMaster sending RPC to server
> master-localhost:7051, [13259ms] Sub rpc: ConnectToMaster received from
> server master-localhost:7051 response Network error:
> java.net.ConnectException: Connection refused: localhost/127.0.0.1:7051,
> [13260ms] delaying RPC due to Service unavailable: Master config
> (localhost:7051) has no leader. Exceptions received:
> org.apache.kudu.client.RecoverableException: java.net.ConnectException:
> Connection refused: localhost/127.0.0.1:7051, [14239ms] querying master,
> [14239ms] Sub rpc: ConnectToMaster sending RPC to server
> master-localhost:7051, [14240ms] Sub rpc: ConnectToMaster received from
> server master-localhost:7051 response Network error:
> java.net.ConnectException: Connection refused: localhost/127.0.0.1:7051,
> [14241ms] delaying RPC due to Service unavailable: Master config
> (localhost:7051) has no leader. Exceptions received:
> org.apache.kudu.client.RecoverableException: java.net.ConnectException:
> Connection refused: loc
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
