[ 
https://issues.apache.org/jira/browse/BEAM-13868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489861#comment-17489861
 ] 

Valentyn Tymofieiev commented on BEAM-13868:
--------------------------------------------

{noformat}
test_1      | hdfs_integration_test run-test-pre: PYTHONHASHSEED='432462468'    
                                                                   
test_1      | hdfs_integration_test run-test: commands[0] | holdup -t 45 
http://namenode:50070 http://datanode:50075
test_1      | hdfs_integration_test run-test: commands[1] | echo 'Waiting for 
safe mode to end.'                                                   
test_1      | Waiting for safe mode to end.IntegrationTest                      
                                                                   
test_1      | hdfs_integration_test run-test: commands[2] | sleep 45            
                                                                   
test_1      | hdfs_integration_test run-test: commands[3] | gsutil cp 
gs://dataflow-samples/shakespeare/kinglear.txt .                                
     
test_1      | Traceback (most recent call last):                         
test_1      |   File 
"/app/sdks/python/target/.tox/hdfs_integration_test/bin/gsutil", line 5, in 
<module>
test_1      |     from gslib.__main__ import main                               
                                                                   
test_1      |   File 
"/app/sdks/python/target/.tox/hdfs_integration_test/lib/python3.9/site-packages/gslib/__main__.py",
 line 75, in <module>
test_1      |     from gslib.command_runner import CommandRunner                
                                                                   
test_1      |   File 
"/app/sdks/python/target/.tox/hdfs_integration_test/lib/python3.9/site-packages/gslib/command_runner.py",
 line 64, in <module>
test_1      |     from gslib.tests.util import HAS_NON_DEFAULT_GS_HOST          
                                                                   
test_1      |   File 
"/app/sdks/python/target/.tox/hdfs_integration_test/lib/python3.9/site-packages/gslib/tests/util.py",
 line 126, in <module>
test_1      |     TEST_ENCRYPTION_KEY1_SHA256_B64 = 
Base64Sha256FromBase64EncryptionKey(                                            
               
test_1      |   File 
"/app/sdks/python/target/.tox/hdfs_integration_test/lib/python3.9/site-packages/gslib/utils/encryption_helper.py",
 line 152, in Base64Sha256FromBase64EncryptionKey
test_1      |     decoded_bytes = base64.decodestring(csek_encryption_key)      
                                                                   
test_1      | AttributeError: module 'base64' has no attribute 'decodestring'   
                                                                   
test_1      | ERROR: InvocationError for command 
/app/sdks/python/target/.tox/hdfs_integration_test/bin/gsutil cp 
gs://dataflow-samples/shakespeare/kinglear.txt . (exited with code 1)
test_1      | hdfs_integration_test run-test-post: commands[0] | bash 
/app/sdks/python/scripts/run_tox_cleanup.sh
test_1      | WARNING: test command found but not installed in testenv          
                                                                   
test_1      |   cmd: /bin/bash                                           
test_1      |   env: /app/sdks/python/target/.tox/hdfs_integration_test         
                                                                   
test_1      | Maybe you forgot to specify a dependency? See also the 
whitelist_externals envconfig setting.
test_1      |                                                            
test_1      | DEPRECATION WARNING: this will be an error in tox 4 and above!    
                                                                   
test_1      | ___________________________________ summary 
____________________________________                                            
         
test_1      | ERROR:   hdfs_integration_test: commands failed                   
                                                                   
hdfs_it-non-jenkins_test_1 exited with code 1                            


{noformat}

> HDFS IT fails on Py3.9
> ----------------------
>
>                 Key: BEAM-13868
>                 URL: https://issues.apache.org/jira/browse/BEAM-13868
>             Project: Beam
>          Issue Type: Sub-task
>          Components: io-py-hadoop
>            Reporter: Valentyn Tymofieiev
>            Assignee: Valentyn Tymofieiev
>            Priority: P2
>




--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to