Anuj Phadke has posted comments on this change. (
http://gerrit.cloudera.org:8080/11540 )
Change subject: IMPALA-7555: Set socket timeout in impala-shell
......................................................................
Patch Set 7:
I added some debugging logging to narrow down the failure. The open() in
connect seems to finish very quickly in milliseconds. Majority of the time
seems to contributed by PingImpalaService()
E AssertionError: Cmd --query="create table
test_kudu_dml_reporting_256dcf63.dml_test (id int primary key, age int null)
partition by hash(id) partitions 2 stored as kudu" was expected to succeed:
Starting Impala Shell without Kerberos authentication
E time taken to connect in open(): 0.000133037567139
E time with socket error: 5.005163908
I removed the handling of exception in the code and the socket timeout
exception was thrown in the PingImpala() function -
Stacktrace
/data/jenkins/workspace/impala-private-parameterized/repos/Impala/tests/shell/test_shell_commandline.py:137:
in test_default_db
result = run_impala_shell_cmd(args)
shell/util.py:97: in run_impala_shell_cmd
result.stderr)
E AssertionError: Cmd -d parquet was expected to succeed: Starting Impala
Shell without Kerberos authentication
E Traceback (most recent call last):
E File
"/data/jenkins/workspace/impala-private-parameterized/repos/Impala/shell/impala_shell.py",
line 1720, in <module>
E shell = ImpalaShell(options, query_options)
E File
"/data/jenkins/workspace/impala-private-parameterized/repos/Impala/shell/impala_shell.py",
line 233, in __init__
E self.do_connect(options.impalad)
E File
"/data/jenkins/workspace/impala-private-parameterized/repos/Impala/shell/impala_shell.py",
line 799, in do_connect
E self._connect()
E File
"/data/jenkins/workspace/impala-private-parameterized/repos/Impala/shell/impala_shell.py",
line 844, in _connect
E result = self.imp_client.connect()
E File
"/data0/jenkins/workspace/impala-private-parameterized/repos/Impala/shell/impala_client.py",
line 260, in connect
E result = self.ping_impala_service()
E File
"/data0/jenkins/workspace/impala-private-parameterized/repos/Impala/shell/impala_client.py",
line 267, in ping_impala_service
E return self.imp_service.PingImpalaService()
E File
"/data/jenkins/workspace/impala-private-parameterized/repos/Impala/shell/gen-py/ImpalaService/ImpalaService.py",
line 229, in PingImpalaService
E return self.recv_PingImpalaService()
E File
"/data/jenkins/workspace/impala-private-parameterized/repos/Impala/shell/gen-py/ImpalaService/ImpalaService.py",
line 240, in recv_PingImpalaService
E (fname, mtype, rseqid) = iprot.readMessageBegin()
E File
"/data/jenkins/workspace/impala-private-parameterized/Impala-Toolchain/thrift-0.9.3-p4/python/lib64/python2.7/site-packages/thrift/protocol/TBinaryProtocol.py",
line 126, in readMessageBegin
E sz = self.readI32()
E File
"/data/jenkins/workspace/impala-private-parameterized/Impala-Toolchain/thrift-0.9.3-p4/python/lib64/python2.7/site-packages/thrift/protocol/TBinaryProtocol.py",
line 206, in readI32
E buff = self.trans.readAll(4)
E File
"/data/jenkins/workspace/impala-private-parameterized/Impala-Toolchain/thrift-0.9.3-p4/python/lib64/python2.7/site-packages/thrift/transport/TTransport.py",
line 58, in readAll
E chunk = self.read(sz - have)
E File
"/data/jenkins/workspace/impala-private-parameterized/Impala-Toolchain/thrift-0.9.3-p4/python/lib64/python2.7/site-packages/thrift/transport/TTransport.py",
line 159, in read
E self.__rbuf = StringIO(self.__trans.read(max(sz, self.__rbuf_size)))
E File
"/data/jenkins/workspace/impala-private-parameterized/Impala-Toolchain/thrift-0.9.3-p4/python/lib64/python2.7/site-packages/thrift/transport/TSocket.py",
line 105, in read
E buff = self.handle.recv(sz)
E socket.timeout: timed out
I think the fix would be to move the timeout before the PingImpalaService.
Might have to get rid of the test I added as it will connect and the timeout
happens in the PingRPC call.
I will verify it once on a kerberized setup.
--
To view, visit http://gerrit.cloudera.org:8080/11540
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I130fc47f7a83f591918d6842634b4e5787d00813
Gerrit-Change-Number: 11540
Gerrit-PatchSet: 7
Gerrit-Owner: Anuj Phadke <[email protected]>
Gerrit-Reviewer: Anuj Phadke <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Lars Volker <[email protected]>
Gerrit-Reviewer: Michael Ho <[email protected]>
Gerrit-Reviewer: Thomas Marshall <[email protected]>
Gerrit-Comment-Date: Mon, 15 Oct 2018 07:35:05 +0000
Gerrit-HasComments: No
