Thomas Tauber-Marshall created IMPALA-7580:
----------------------------------------------
Summary: test_local_catalog fails on S3 build
Key: IMPALA-7580
URL: https://issues.apache.org/jira/browse/IMPALA-7580
Project: IMPALA
Issue Type: Bug
Affects Versions: Impala 3.1.0
Reporter: Thomas Tauber-Marshall
Assignee: Tianyi Wang
{noformat}
07:07:19 _____________ TestAutomaticCatalogInvalidation.test_local_catalog
______________
07:07:19 custom_cluster/test_automatic_invalidation.py:65: in test_local_catalog
07:07:19 self._run_test(cursor)
07:07:19 custom_cluster/test_automatic_invalidation.py:45: in _run_test
07:07:19 assert self.metadata_cache_string in self._get_catalog_object()
07:07:19 E assert 'columns (list) = list<struct>' in '<!--\nLicensed to
the Apache Software Foundation (ASF) under one\nor more contributor license
agreements. See the NO...ot;functional",\n 02: tbl_name (string) =
"alltypes",\n },\n}</pre>\n\n</div>\n</body>\n</html>\n\n'
07:07:19 E + where 'columns (list) = list<struct>' =
<test_automatic_invalidation.TestAutomaticCatalogInvalidation object at
0x7faac427b450>.metadata_cache_string
07:07:19 E + and '<!--\nLicensed to the Apache Software Foundation (ASF)
under one\nor more contributor license agreements. See the
NO...ot;functional",\n 02: tbl_name (string) = "alltypes",\n
},\n}</pre>\n\n</div>\n</body>\n</html>\n\n' = <bound method
TestAutomaticCatalogInvalidation._get_catalog_object of
<test_automatic_invalidation.TestAutomaticCatalogInvalidation object at
0x7faac427b450>>()
07:07:19 E + where <bound method
TestAutomaticCatalogInvalidation._get_catalog_object of
<test_automatic_invalidation.TestAutomaticCatalogInvalidation object at
0x7faac427b450>> =
<test_automatic_invalidation.TestAutomaticCatalogInvalidation object at
0x7faac427b450>._get_catalog_object
07:07:19 ---------------------------- Captured stderr setup
-----------------------------
07:07:19 -- 2018-09-16 06:23:18,238 INFO MainThread: Starting cluster with
command:
/data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/bin/start-impala-cluster.py
--cluster_size=3 --num_coordinators=3
--log_dir=/data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests
--log_level=1 '--impalad_args="--invalidate_tables_timeout_s=5
--use_local_catalog" ' '--state_store_args="--statestore_update_frequency_ms=50
--statestore_priority_update_frequency_ms=50
--statestore_heartbeat_frequency_ms=50" '
'--catalogd_args="--invalidate_tables_timeout_s=5 --catalog_topic_mode=minimal"
'
07:07:19 06:23:18 MainThread: Starting State Store logging to
/data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/statestored.INFO
07:07:19 06:23:18 MainThread: Starting Catalog Service logging to
/data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/catalogd.INFO
07:07:19 06:23:20 MainThread: Starting Impala Daemon logging to
/data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/impalad.INFO
07:07:19 06:23:21 MainThread: Starting Impala Daemon logging to
/data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/impalad_node1.INFO
07:07:19 06:23:22 MainThread: Starting Impala Daemon logging to
/data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/impalad_node2.INFO
07:07:19 06:23:25 MainThread: Found 3 impalad/1 statestored/1 catalogd
process(es)
07:07:19 06:23:25 MainThread: Getting num_known_live_backends from
impala-ec2-centos74-m5-4xlarge-ondemand-0c64.vpc.cloudera.com:25000
07:07:19 06:23:25 MainThread: Waiting for num_known_live_backends=3. Current
value: 1
07:07:19 06:23:26 MainThread: Getting num_known_live_backends from
impala-ec2-centos74-m5-4xlarge-ondemand-0c64.vpc.cloudera.com:25000
07:07:19 06:23:26 MainThread: num_known_live_backends has reached value: 3
07:07:19 06:23:26 MainThread: Getting num_known_live_backends from
impala-ec2-centos74-m5-4xlarge-ondemand-0c64.vpc.cloudera.com:25001
07:07:19 06:23:26 MainThread: num_known_live_backends has reached value: 3
07:07:19 06:23:26 MainThread: Getting num_known_live_backends from
impala-ec2-centos74-m5-4xlarge-ondemand-0c64.vpc.cloudera.com:25002
07:07:19 06:23:26 MainThread: num_known_live_backends has reached value: 3
07:07:19 06:23:26 MainThread: Impala Cluster Running with 3 nodes (3
coordinators, 3 executors).
07:07:19 -- 2018-09-16 06:23:26,087 INFO MainThread: Found 3 impalad/1
statestored/1 catalogd process(es)
07:07:19 -- 2018-09-16 06:23:26,088 INFO MainThread: Getting metric:
statestore.live-backends from
impala-ec2-centos74-m5-4xlarge-ondemand-0c64.vpc.cloudera.com:25010
07:07:19 -- 2018-09-16 06:23:26,089 INFO MainThread: Metric
'statestore.live-backends' has reached desired value: 4
07:07:19 -- 2018-09-16 06:23:26,089 INFO MainThread: Getting
num_known_live_backends from
impala-ec2-centos74-m5-4xlarge-ondemand-0c64.vpc.cloudera.com:25000
07:07:19 -- 2018-09-16 06:23:26,089 INFO MainThread:
num_known_live_backends has reached value: 3
07:07:19 -- 2018-09-16 06:23:26,089 INFO MainThread: Getting
num_known_live_backends from
impala-ec2-centos74-m5-4xlarge-ondemand-0c64.vpc.cloudera.com:25001
07:07:19 -- 2018-09-16 06:23:26,090 INFO MainThread:
num_known_live_backends has reached value: 3
07:07:19 -- 2018-09-16 06:23:26,090 INFO MainThread: Getting
num_known_live_backends from
impala-ec2-centos74-m5-4xlarge-ondemand-0c64.vpc.cloudera.com:25002
07:07:19 -- 2018-09-16 06:23:26,091 INFO MainThread:
num_known_live_backends has reached value: 3
07:07:19 -- connecting to: localhost:21000
07:07:19 -- 2018-09-16 06:23:26,099 ERROR MainThread: Failed to open
transport (tries_left=3)
07:07:19 Traceback (most recent call last):
07:07:19 File
"/data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/infra/python/env/lib/python2.7/site-packages/impala/hiveserver2.py",
line 940, in _execute
07:07:19 return func(request)
07:07:19 File
"/data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/infra/python/env/lib/python2.7/site-packages/impala/_thrift_gen/TCLIService/TCLIService.py",
line 175, in OpenSession
07:07:19 return self.recv_OpenSession()
07:07:19 File
"/data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/infra/python/env/lib/python2.7/site-packages/impala/_thrift_gen/TCLIService/TCLIService.py",
line 186, in recv_OpenSession
07:07:19 (fname, mtype, rseqid) = self._iprot.readMessageBegin()
07:07:19 File
"/data/jenkins/workspace/impala-asf-master-core-s3/Impala-Toolchain/thrift-0.9.3-p4/python/lib64/python2.7/site-packages/thrift/protocol/TBinaryProtocol.py",
line 126, in readMessageBegin
07:07:19 sz = self.readI32()
07:07:19 File
"/data/jenkins/workspace/impala-asf-master-core-s3/Impala-Toolchain/thrift-0.9.3-p4/python/lib64/python2.7/site-packages/thrift/protocol/TBinaryProtocol.py",
line 206, in readI32
07:07:19 buff = self.trans.readAll(4)
07:07:19 File
"/data/jenkins/workspace/impala-asf-master-core-s3/Impala-Toolchain/thrift-0.9.3-p4/python/lib64/python2.7/site-packages/thrift/transport/TTransport.py",
line 58, in readAll
07:07:19 chunk = self.read(sz - have)
07:07:19 File
"/data/jenkins/workspace/impala-asf-master-core-s3/Impala-Toolchain/thrift-0.9.3-p4/python/lib64/python2.7/site-packages/thrift/transport/TTransport.py",
line 159, in read
07:07:19 self.__rbuf = StringIO(self.__trans.read(max(sz,
self.__rbuf_size)))
07:07:19 File
"/data/jenkins/workspace/impala-asf-master-core-s3/Impala-Toolchain/thrift-0.9.3-p4/python/lib64/python2.7/site-packages/thrift/transport/TSocket.py",
line 120, in read
07:07:19 message='TSocket read 0 bytes')
07:07:19 TTransportException: TSocket read 0 bytes
{noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
