[
https://issues.apache.org/jira/browse/HADOOP-13502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Nauroth updated HADOOP-13502:
-----------------------------------
Attachment: HADOOP-13502-branch-2.004.patch
I'm attaching patch 004. The only difference is that I'm taking this
opportunity to update .gitignore for the hadoop-openstack auth-keys.xml file.
Steve, I cannot repro the hadoop-openstack test failures that you mentioned.
{{TestSwiftContractCreate}} runs clean, and I see the following in the log
showing that the contract XML flags are causing tests to be skipped correctly.
{code}
2016-10-05 10:30:31,296 [Thread-0] INFO contract.ContractTestUtils
(ContractTestUtils.java:skip(432)) - Skipping: This Filesystem allows a file to
overwrite a directory
{code}
{code}
2016-10-05 10:30:35,037 [Thread-5] INFO contract.ContractTestUtils
(ContractTestUtils.java:skip(432)) - Skipping: This Filesystem delays
visibility of newly created files
{code}
{code}
2016-10-05 10:30:37,113 [Thread-6] INFO contract.ContractTestUtils
(ContractTestUtils.java:skip(432)) - Skipping: blobstores can't distinguish
empty directories from files
{code}
Could you please try testing again? Maybe you need a fresh "mvn install" to
get the hadoop-common changes installed.
This is my first time running the hadoop-openstack tests. I'm consistently
getting failures due to socket read timeouts in these tests:
*
{{TestFSMainOperationsSwift#testGlobStatusFilterWithSomePathMatchesAndTrivialFilter}}
* {{TestFSMainOperationsSwift#testWriteReadAndDeleteTwoBlocks}}
* {{TestFSMainOperationsSwift#testRenameFileToExistingParent}}
* {{TestSwiftFileSystemRename#testRenameFile}}
* {{TestSwiftFileSystemRename#testRenameFileIntoExistingDirectory}}
I'm running against the public Rackspace DFW endpoint, not a VM within
Rackspace, so I assume public Internet latency is a contributing factor. I did
full test runs before and after my patch, and I confirmed that I was getting
the same results before and after.
> Rename/split fs.contract.is-blobstore flag used by contract tests.
> ------------------------------------------------------------------
>
> Key: HADOOP-13502
> URL: https://issues.apache.org/jira/browse/HADOOP-13502
> Project: Hadoop Common
> Issue Type: Improvement
> Components: test
> Reporter: Chris Nauroth
> Assignee: Chris Nauroth
> Priority: Minor
> Attachments: HADOOP-13502-branch-2.001.patch,
> HADOOP-13502-branch-2.002.patch, HADOOP-13502-branch-2.003.patch,
> HADOOP-13502-branch-2.004.patch
>
>
> The {{fs.contract.is-blobstore}} flag guards against execution of several
> contract tests to account for known limitations with blob stores. However,
> the name is not entirely accurate, because it's still possible that a file
> system implemented against a blob store could pass those tests, depending on
> whether or not the implementation matches the semantics of HDFS. This issue
> proposes to rename the flag or split it into different flags with different
> definitions for the semantics covered by the current flag.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
