Hi there,
I followed the wiki
https://cwiki.apache.org/confluence/display/IMPALA/How+to+load+and+run+Impala+tests
carefully but still have some problems in my local env.
1. I need to manually execute "hdfs dfs -mkdir /test-warehouse/emptytable"
to get rid of some fe test error.
2. I have authz-policy.ini in HDFS, but I still get authorization errors.
TestSelect[0](com.cloudera.impala.analysis.AuthorizationTest) Time elapsed:
0.333 sec <<< FAILURE!
java.lang.AssertionError: got error:
User 'amos' does not have privileges to execute 'SELECT' on: default.nodb
expected:
User 'amos' does not have privileges to execute 'SELECT' on: nodb.alltypes
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at
com.cloudera.impala.analysis.AuthorizationTest.AuthzError(AuthorizationTest.java:2220)
at
com.cloudera.impala.analysis.AuthorizationTest.AuthzError(AuthorizationTest.java:2203)
at
com.cloudera.impala.analysis.AuthorizationTest.AuthzError(AuthorizationTest.java:2197)
at
com.cloudera.impala.analysis.AuthorizationTest.TestSelect(AuthorizationTest.java:512)
TestSelect[1](com.cloudera.impala.analysis.AuthorizationTest) Time elapsed:
0.324 sec <<< FAILURE!
java.lang.AssertionError: got error:
User 'amos' does not have privileges to execute 'SELECT' on: default.nodb
expected:
User 'amos' does not have privileges to execute 'SELECT' on: nodb.alltypes
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at
com.cloudera.impala.analysis.AuthorizationTest.AuthzError(AuthorizationTest.java:2220)
at
com.cloudera.impala.analysis.AuthorizationTest.AuthzError(AuthorizationTest.java:2203)
at
com.cloudera.impala.analysis.AuthorizationTest.AuthzError(AuthorizationTest.java:2197)
at
com.cloudera.impala.analysis.AuthorizationTest.TestSelect(AuthorizationTest.java:512)
Results :
Failed tests:
AuthorizationTest.TestSelect:512->AuthzError:2197->AuthzError:2203->AuthzError:2220
got error:
User 'amos' does not have privileges to execute 'SELECT' on: default.nodb
expected:
User 'amos' does not have privileges to execute 'SELECT' on: nodb.alltypes
AuthorizationTest.TestSelect:512->AuthzError:2197->AuthzError:2203->AuthzError:2220
got error:
User 'amos' does not have privileges to execute 'SELECT' on: default.nodb
expected:
User 'amos' does not have privileges to execute 'SELECT' on: nodb.alltypes
3. For end-to-end tests, I encountered two kinds of errors
a) connection refused.
SET sync_ddl=False;
-- executing against localhost:21000
DROP DATABASE `test_drop_cleans_hdfs_dirs_fdfd4f8` CASCADE;
___________________ ERROR at setup of TestLoadData.test_load[exec_option:
{'disable_codegen': False, 'abort_on_error': 1,
'exec_single_node_rows_threshold': 0, 'batch_size': 0, 'num_nodes': 0} |
table_format: text/none] ___________________
[gw5] linux2 -- Python 2.6.6
/home/amos/incubator-impala/bin/../infra/python/env/bin/python
metadata/test_load.py:77: in setup_method
"{0}/{1}/100101.txt".format(STAGING_PATH, i))
util/hdfs_util.py:122: in copy
data = self.read_file(src)
../infra/python/env/lib/python2.6/site-packages/pywebhdfs/webhdfs.py:183: in
read_file
response = requests.get(uri, allow_redirects=True)
../infra/python/env/lib/python2.6/site-packages/requests/api.py:69: in get
return request('get', url, params=params, **kwargs)
../infra/python/env/lib/python2.6/site-packages/requests/api.py:50: in request
response = session.request(method=method, url=url, **kwargs)
../infra/python/env/lib/python2.6/site-packages/requests/sessions.py:465: in
request
resp = self.send(prep, **send_kwargs)
../infra/python/env/lib/python2.6/site-packages/requests/sessions.py:594: in
send
history = [resp for resp in gen] if allow_redirects else []
../infra/python/env/lib/python2.6/site-packages/requests/sessions.py:196: in
resolve_redirects
**adapter_kwargs
../infra/python/env/lib/python2.6/site-packages/requests/sessions.py:573: in
send
r = adapter.send(request, **kwargs)
../infra/python/env/lib/python2.6/site-packages/requests/adapters.py:415: in
send
raise ConnectionError(err, request=request)
E ConnectionError: ('Connection aborted.', error(111, 'Connection refused'))
b) stats not match
[gw4] linux2 -- Python 2.6.6
/home/amos/incubator-impala/bin/../infra/python/env/bin/python
metadata/test_metadata_query_statements.py:67: in test_show_stats
self.run_test_case('QueryTest/show-stats', vector, "functional")
common/impala_test_suite.py:342: in run_test_case
self.__verify_results_and_errors(vector, test_section, result, use_db)
common/impala_test_suite.py:234: in __verify_results_and_errors
replace_filenames_with_placeholder)
common/test_result_verifier.py:398: in verify_raw_results
VERIFIER_MAP[verifier](expected, actual)
common/test_result_verifier.py:231: in verify_query_result_is_equal
assert expected_results == actual_results
...
-- executing against localhost:21000
show column stats alltypes_clone;
MainThread: Comparing QueryTestResults (expected vs actual):
'bigint_col','BIGINT',10,-1,8,8 == 'bigint_col','BIGINT',10,-1,8,8
'bool_col','BOOLEAN',2,-1,1,1 == 'bool_col','BOOLEAN',2,-1,1,1
'date_string_col','STRING',736,-1,8,8 == 'date_string_col','STRING',736,-1,8,8
'double_col','DOUBLE',-1,-1,8,8 == 'double_col','DOUBLE',-1,-1,8,8
'float_col','FLOAT',10,-1,4,4 == 'float_col','FLOAT',10,-1,4,4
'id','INT',7505,-1,4,4 == 'id','INT',7505,-1,4,4
'int_col','INT',-1,-1,4,4 == 'int_col','INT',-1,-1,4,4
'month','INT',12,0,4,4 == 'month','INT',12,0,4,4
'smallint_col','SMALLINT',10,-1,2,2 == 'smallint_col','SMALLINT',10,-1,2,2
'string_col','STRING',10,-1,-1,-1 == 'string_col','STRING',10,-1,-1,-1
'timestamp_col','TIMESTAMP',7554,-1,16,16 !=
'timestamp_col','TIMESTAMP',7552,-1,16,16
'tinyint_col','TINYINT',10,-1,1,1 == 'tinyint_col','TINYINT',10,-1,1,1
'year','INT',2,0,4,4 == 'year','INT',2,0,4,4
I'm using CentOS 6.8 final. I have no idea what goes wrong. Any help is
much appreciated!
Best regards,
Amos
