Hi there,

I followed the wiki
https://cwiki.apache.org/confluence/display/IMPALA/How+to+load+and+run+Impala+tests
carefully but still have some problems in my local env.

1. I need to manually execute "hdfs dfs -mkdir /test-warehouse/emptytable"
to get rid of some fe test error.


2. I have authz-policy.ini in HDFS, but I still get authorization errors.

TestSelect[0](com.cloudera.impala.analysis.AuthorizationTest)  Time elapsed: 
0.333 sec  <<< FAILURE!
java.lang.AssertionError: got error:
User 'amos' does not have privileges to execute 'SELECT' on: default.nodb
expected:
User 'amos' does not have privileges to execute 'SELECT' on: nodb.alltypes
  at org.junit.Assert.fail(Assert.java:88)
  at org.junit.Assert.assertTrue(Assert.java:41)
  at 
com.cloudera.impala.analysis.AuthorizationTest.AuthzError(AuthorizationTest.java:2220)
  at 
com.cloudera.impala.analysis.AuthorizationTest.AuthzError(AuthorizationTest.java:2203)
  at 
com.cloudera.impala.analysis.AuthorizationTest.AuthzError(AuthorizationTest.java:2197)
  at 
com.cloudera.impala.analysis.AuthorizationTest.TestSelect(AuthorizationTest.java:512)

TestSelect[1](com.cloudera.impala.analysis.AuthorizationTest)  Time elapsed: 
0.324 sec  <<< FAILURE!
java.lang.AssertionError: got error:
User 'amos' does not have privileges to execute 'SELECT' on: default.nodb
expected:
User 'amos' does not have privileges to execute 'SELECT' on: nodb.alltypes
  at org.junit.Assert.fail(Assert.java:88)
  at org.junit.Assert.assertTrue(Assert.java:41)
  at 
com.cloudera.impala.analysis.AuthorizationTest.AuthzError(AuthorizationTest.java:2220)
  at 
com.cloudera.impala.analysis.AuthorizationTest.AuthzError(AuthorizationTest.java:2203)
  at 
com.cloudera.impala.analysis.AuthorizationTest.AuthzError(AuthorizationTest.java:2197)
  at 
com.cloudera.impala.analysis.AuthorizationTest.TestSelect(AuthorizationTest.java:512)


Results :

Failed tests:
  
AuthorizationTest.TestSelect:512->AuthzError:2197->AuthzError:2203->AuthzError:2220
 got error:
User 'amos' does not have privileges to execute 'SELECT' on: default.nodb
expected:
User 'amos' does not have privileges to execute 'SELECT' on: nodb.alltypes
  
AuthorizationTest.TestSelect:512->AuthzError:2197->AuthzError:2203->AuthzError:2220
 got error:
User 'amos' does not have privileges to execute 'SELECT' on: default.nodb
expected:
User 'amos' does not have privileges to execute 'SELECT' on: nodb.alltypes




3. For end-to-end tests, I encountered two kinds of errors

  a) connection refused.

  SET sync_ddl=False;
-- executing against localhost:21000
DROP DATABASE `test_drop_cleans_hdfs_dirs_fdfd4f8` CASCADE;

___________________ ERROR at setup of TestLoadData.test_load[exec_option: 
{'disable_codegen': False, 'abort_on_error': 1, 
'exec_single_node_rows_threshold': 0, 'batch_size': 0, 'num_nodes': 0} | 
table_format: text/none] ___________________
[gw5] linux2 -- Python 2.6.6 
/home/amos/incubator-impala/bin/../infra/python/env/bin/python
metadata/test_load.py:77: in setup_method
    "{0}/{1}/100101.txt".format(STAGING_PATH, i))
util/hdfs_util.py:122: in copy
    data = self.read_file(src)
../infra/python/env/lib/python2.6/site-packages/pywebhdfs/webhdfs.py:183: in 
read_file
    response = requests.get(uri, allow_redirects=True)
../infra/python/env/lib/python2.6/site-packages/requests/api.py:69: in get
    return request('get', url, params=params, **kwargs)
../infra/python/env/lib/python2.6/site-packages/requests/api.py:50: in request
    response = session.request(method=method, url=url, **kwargs)
../infra/python/env/lib/python2.6/site-packages/requests/sessions.py:465: in 
request
    resp = self.send(prep, **send_kwargs)
../infra/python/env/lib/python2.6/site-packages/requests/sessions.py:594: in 
send
    history = [resp for resp in gen] if allow_redirects else []
../infra/python/env/lib/python2.6/site-packages/requests/sessions.py:196: in 
resolve_redirects
    **adapter_kwargs
../infra/python/env/lib/python2.6/site-packages/requests/sessions.py:573: in 
send
    r = adapter.send(request, **kwargs)
../infra/python/env/lib/python2.6/site-packages/requests/adapters.py:415: in 
send
    raise ConnectionError(err, request=request)
E   ConnectionError: ('Connection aborted.', error(111, 'Connection refused'))

   b) stats not match

[gw4] linux2 -- Python 2.6.6 
/home/amos/incubator-impala/bin/../infra/python/env/bin/python
metadata/test_metadata_query_statements.py:67: in test_show_stats
    self.run_test_case('QueryTest/show-stats', vector, "functional")
common/impala_test_suite.py:342: in run_test_case
    self.__verify_results_and_errors(vector, test_section, result, use_db)
common/impala_test_suite.py:234: in __verify_results_and_errors
    replace_filenames_with_placeholder)
common/test_result_verifier.py:398: in verify_raw_results
    VERIFIER_MAP[verifier](expected, actual)
common/test_result_verifier.py:231: in verify_query_result_is_equal
    assert expected_results == actual_results

...

   -- executing against localhost:21000
show column stats alltypes_clone;

MainThread: Comparing QueryTestResults (expected vs actual):
'bigint_col','BIGINT',10,-1,8,8 == 'bigint_col','BIGINT',10,-1,8,8
'bool_col','BOOLEAN',2,-1,1,1 == 'bool_col','BOOLEAN',2,-1,1,1
'date_string_col','STRING',736,-1,8,8 == 'date_string_col','STRING',736,-1,8,8
'double_col','DOUBLE',-1,-1,8,8 == 'double_col','DOUBLE',-1,-1,8,8
'float_col','FLOAT',10,-1,4,4 == 'float_col','FLOAT',10,-1,4,4
'id','INT',7505,-1,4,4 == 'id','INT',7505,-1,4,4
'int_col','INT',-1,-1,4,4 == 'int_col','INT',-1,-1,4,4
'month','INT',12,0,4,4 == 'month','INT',12,0,4,4
'smallint_col','SMALLINT',10,-1,2,2 == 'smallint_col','SMALLINT',10,-1,2,2
'string_col','STRING',10,-1,-1,-1 == 'string_col','STRING',10,-1,-1,-1
'timestamp_col','TIMESTAMP',7554,-1,16,16 != 
'timestamp_col','TIMESTAMP',7552,-1,16,16
'tinyint_col','TINYINT',10,-1,1,1 == 'tinyint_col','TINYINT',10,-1,1,1
'year','INT',2,0,4,4 == 'year','INT',2,0,4,4


I'm using CentOS 6.8 final. I have no idea what goes wrong. Any help is
much appreciated!

Best regards,
Amos

Reply via email to