[
https://issues.apache.org/jira/browse/IMPALA-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16514480#comment-16514480
]
Tianyi Wang commented on IMPALA-7169:
-------------------------------------
The log in the failed build:
{noformat}
2018-06-11 16:59:54,285 INFO org.apache.hadoop.hdfs.StateChange: DIR*
completeFile: /test-warehouse/test_enc
ryption_db.db/t1/j=3/j3.txt is closed by DFSClient_NONMAPREDUCE_-192125689_43
2018-06-11 17:00:00,067 INFO org.apache.hadoop.fs.TrashPolicyDefault:
TrashPolicyDefault#deleteCheckpoint fo
r trashRoot: hdfs://localhost:20500/user/jenkins/.Trash
2018-06-11 17:00:00,072 INFO org.apache.hadoop.fs.TrashPolicyDefault: Created
trash checkpoint: /user/jenkin
s/.Trash/180611170000
2018-06-11 17:00:00,894 WARN org.apache.hadoop.security.UserGroupInformation:
PriviledgedActionException as:
jenkins (auth:SIMPLE) cause:java.io.FileNotFoundException: File does not exist:
/user/jenkins/.Trash/Current
/test-warehouse/test_encryption_db.db/t1/j=1/j1.txt
{noformat}
The log of a success build
{noformat}
2018-06-13 22:20:24,736 INFO org.apache.hadoop.hdfs.StateChange: DIR*
completeFile: /test-warehouse/test_encryption_db.db/
t1/j=3/j3.txt is closed by DFSClient_NONMAPREDUCE_-2038519081_43
2018-06-13 22:20:31,100 WARN org.apache.hadoop.security.UserGroupInformation:
PriviledgedActionException as:jenkins (auth:
SIMPLE) cause:java.io.FileNotFoundException: File does not exist:
/test-warehouse/test_encryption_db.db/t1/j=1/j1.txt
2018-06-13 22:20:31,108 WARN org.apache.hadoop.security.UserGroupInformation:
PriviledgedActionException as:jenkins (auth:
SIMPLE) cause:java.io.FileNotFoundException: File does not exist:
/test-warehouse/test_encryption_db.db/t1/j=1
2018-06-13 22:20:31,168 INFO BlockStateChange: BLOCK* addToInvalidates:
blk_1073755231_14407 127.0.0.1:31000 127.0.0.1:310
01 127.0.0.1:31002
2018-06-13 22:20:33,664 INFO BlockStateChange: BLOCK* BlockManager: ask
127.0.0.1:31001 to delete [blk_1073755231_14407]
2018-06-13 22:20:36,665 INFO BlockStateChange: BLOCK* BlockManager: ask
127.0.0.1:31002 to delete [blk_1073755231_14407]
2018-06-13 22:20:37,098 WARN org.apache.hadoop.security.UserGroupInformation:
PriviledgedActionException as:jenkins (auth:
SIMPLE) cause:java.io.FileNotFoundException: File does not exist:
/test-warehouse/test_encryption_db.db/t1/j=2/j2.txt
2018-06-13 22:20:37,107 WARN org.apache.hadoop.security.UserGroupInformation:
PriviledgedActionException as:jenkins (auth:
SIMPLE) cause:java.io.FileNotFoundException: File does not exist:
/test-warehouse/test_encryption_db.db/t1/j=2
2018-06-13 22:20:37,167 INFO BlockStateChange: BLOCK* addToInvalidates:
blk_1073755232_14408 127.0.0.1:31001 127.0.0.1:310
02 127.0.0.1:31000
2018-06-13 22:20:39,665 INFO BlockStateChange: BLOCK* BlockManager: ask
127.0.0.1:31002 to delete [blk_1073755232_14408]
2018-06-13 22:20:42,666 INFO BlockStateChange: BLOCK* BlockManager: ask
127.0.0.1:31001 to delete [blk_1073755232_14408]
2018-06-13 22:20:43,107 WARN org.apache.hadoop.security.UserGroupInformation:
PriviledgedActionException as:jenkins (auth:
SIMPLE) cause:java.io.FileNotFoundException: File does not exist:
/test-warehouse/test_encryption_db.db/t1/j=3/j3.txt
2018-06-13 22:20:43,117 WARN org.apache.hadoop.security.UserGroupInformation:
PriviledgedActionException as:jenkins (auth:
SIMPLE) cause:java.io.FileNotFoundException: File does not exist:
/test-warehouse/test_encryption_db.db/t1/j=3
2018-06-13 22:20:45,666 INFO BlockStateChange: BLOCK* BlockManager: ask
127.0.0.1:31000 to delete [blk_1073755232_14408, b
lk_1073755231_14407]
2018-06-13 22:20:59,342 INFO BlockStateChange: BLOCK* addToInvalidates:
blk_1073755230_14406 127.0.0.1:31001 127.0.0.1:310
02 127.0.0.1:31000
{noformat}
Maybe the "TrashPolicyDefault#deleteCheckpoint" operation raced with something.
> TestHdfsEncryption::()::test_drop_partition_encrypt fails to find file
> ----------------------------------------------------------------------
>
> Key: IMPALA-7169
> URL: https://issues.apache.org/jira/browse/IMPALA-7169
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 2.13.0
> Reporter: Lars Volker
> Assignee: Tianyi Wang
> Priority: Critical
> Labels: broken-build, flaky
>
> {noformat}
> F
> metadata/test_hdfs_encryption.py::TestHdfsEncryption::()::test_drop_partition_encrypt
> metadata/test_hdfs_encryption.py:202: in test_drop_partition_encrypt
> assert self.hdfs_client.exists(
> E assert <bound method PyWebHdfsClientWithChmod.exists of
> <tests.util.hdfs_util.PyWebHdfsClientWithChmod object at
> 0xba6ee90>>('/user/jenkins/.Trash/Current/test-warehouse/test_encryption_db.db/t1/j=1/j1.txt')
> E + where <bound method PyWebHdfsClientWithChmod.exists of
> <tests.util.hdfs_util.PyWebHdfsClientWithChmod object at 0xba6ee90>> =
> <tests.util.hdfs_util.PyWebHdfsClientWithChmod object at 0xba6ee90>.exists
> E + where <tests.util.hdfs_util.PyWebHdfsClientWithChmod object at
> 0xba6ee90> = <test_hdfs_encryption.TestHdfsEncryption object at
> 0xba6ed50>.hdfs_client
> E + and
> '/user/jenkins/.Trash/Current/test-warehouse/test_encryption_db.db/t1/j=1/j1.txt'
> = <built-in method format of str object at 0x3d6f780>('jenkins',
> 'test_encryption_db')
> E + where <built-in method format of str object at 0x3d6f780> =
> '/user/{0}/.Trash/Current/test-warehouse/{1}.db/t1/j=1/j1.txt'.format
> E + and 'jenkins' = <function getuser at 0xb722a8>()
> E + where <function getuser at 0xb722a8> = getpass.getuser
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
