[ 
https://issues.apache.org/jira/browse/IMPALA-14630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18045397#comment-18045397
 ] 

Quanlong Huang commented on IMPALA-14630:
-----------------------------------------

Hi [~rizaon], assigning this to you since you worked on IMPALA-14595 and might 
have some ideas in how to debug this. Feel free to reassign this if appropriate.

> test_drop_table_with_purge and test_drop_partition_with_purge are flaky in 
> Ozone builds
> ---------------------------------------------------------------------------------------
>
>                 Key: IMPALA-14630
>                 URL: https://issues.apache.org/jira/browse/IMPALA-14630
>             Project: IMPALA
>          Issue Type: Bug
>            Reporter: Quanlong Huang
>            Assignee: Riza Suminto
>            Priority: Critical
>
> After IMPALA-14595, we still see test_drop_table_with_purge and 
> test_drop_partition_with_purge fail due to the deleted file not existing in 
> the trash folder. The path has been changed after IMPALA-14595 but it seems 
> the files don't exist sometimes. In some Ozone builds, they still pass. So 
> might be a flaky issue.
> *metadata.test_ddl.TestDdlStatements.test_drop_table_with_purge*
> {code:python}
> /data/jenkins/workspace/impala-cdw-master-staging-core-ozone/repos/Impala/tests/metadata/test_ddl.py:100:
>  in test_drop_table_with_purge
>     assert self.filesystem_client.exists("{}/t1/t1.txt".format(trash))
> E   assert <bound method HadoopFsCommandLineClient.exists of 
> <tests.util.hdfs_util.HadoopFsCommandLineClient object at 
> 0x7fb15bfae430>>('ofs://localhost:9862/impala/test-warehouse/.Trash/jenkins/Current/test_drop_table_with_purge_58c75c18.db/t1/t1.txt')
> E    +  where <bound method HadoopFsCommandLineClient.exists of 
> <tests.util.hdfs_util.HadoopFsCommandLineClient object at 0x7fb15bfae430>> = 
> <tests.util.hdfs_util.HadoopFsCommandLineClient object at 
> 0x7fb15bfae430>.exists
> E    +    where <tests.util.hdfs_util.HadoopFsCommandLineClient object at 
> 0x7fb15bfae430> = <tests.metadata.test_ddl.TestDdlStatements object at 
> 0x7fb15ef63f40>.filesystem_client
> E    +  and   
> 'ofs://localhost:9862/impala/test-warehouse/.Trash/jenkins/Current/test_drop_table_with_purge_58c75c18.db/t1/t1.txt'
>  = <built-in method format of str object at 
> 0x7fb15ea535b0>('ofs://localhost:9862/impala/test-warehouse/.Trash/jenkins/Current/test_drop_table_with_purge_58c75c18.db')
> E    +    where <built-in method format of str object at 0x7fb15ea535b0> = 
> '{}/t1/t1.txt'.format{code}
> *metadata.test_ddl.TestDdlStatements.test_drop_partition_with_purge*
> {code:python}
> /data/jenkins/workspace/impala-cdw-master-staging-core-ozone/repos/Impala/tests/metadata/test_ddl.py:631:
>  in test_drop_partition_with_purge
>     assert self.filesystem_client.exists('{}/t1/j=1/j1.txt'.format(trash))
> E   assert <bound method HadoopFsCommandLineClient.exists of 
> <tests.util.hdfs_util.HadoopFsCommandLineClient object at 
> 0x7f5024eeef10>>('ofs://localhost:9862/impala/test-warehouse/.Trash/jenkins/Current/test_drop_partition_with_purge_b5de45cb.db/t1/j=1/j1.txt')
> E    +  where <bound method HadoopFsCommandLineClient.exists of 
> <tests.util.hdfs_util.HadoopFsCommandLineClient object at 0x7f5024eeef10>> = 
> <tests.util.hdfs_util.HadoopFsCommandLineClient object at 
> 0x7f5024eeef10>.exists
> E    +    where <tests.util.hdfs_util.HadoopFsCommandLineClient object at 
> 0x7f5024eeef10> = <tests.metadata.test_ddl.TestDdlStatements object at 
> 0x7f5024ef3d60>.filesystem_client
> E    +  and   
> 'ofs://localhost:9862/impala/test-warehouse/.Trash/jenkins/Current/test_drop_partition_with_purge_b5de45cb.db/t1/j=1/j1.txt'
>  = <built-in method format of str object at 
> 0x7f5027a19bc0>('ofs://localhost:9862/impala/test-warehouse/.Trash/jenkins/Current/test_drop_partition_with_purge_b5de45cb.db')
> E    +    where <built-in method format of str object at 0x7f5027a19bc0> = 
> '{}/t1/j=1/j1.txt'.format{code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to