[
https://issues.apache.org/jira/browse/HADOOP-18960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897366#comment-17897366
]
ASF GitHub Bot commented on HADOOP-18960:
-----------------------------------------
anujmodi2021 opened a new pull request, #7153:
URL: https://github.com/apache/hadoop/pull/7153
### Description of PR
Commit on trunk:
https://github.com/apache/hadoop/commit/487727a5d10a3979daf6741fa9c82792a363d60d
PR on trunk: https://github.com/apache/hadoop/pull/7104
Target Jira: https://issues.apache.org/jira/browse/HADOOP-18960
The execution of contract-tests in abfs works as per executionId =
integration-test-abfs-parallel-classes of the pom. The tests would work in
different jvms, and at a given instance multiple such jvms could be there,
depending on ${testsThreadCount}. The problem is that all the test jvms for
contract-test use the same container for test runs which is defined by
fs.contract.test.fs.abfs. Due to this, one jvm root-contract-runs can influence
other jvm's root-contract-runs. This leads to CI failures for hadoop-azure
package.
Hence making these tests run in parallel so that they don't interfere with
each other.
This PR also fixes some test failures reported by Jira:
https://issues.apache.org/jira/browse/HADOOP-19106
### How was this patch tested?
Test Suite Run Result pasted in comments below.
The failing tests are known and due to some missing configs. They are fixed
in https://github.com/apache/hadoop/pull/6847
> ABFS contract-tests with Hadoop-Commons intermittently failing
> --------------------------------------------------------------
>
> Key: HADOOP-18960
> URL: https://issues.apache.org/jira/browse/HADOOP-18960
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
> Reporter: Pranav Saxena
> Assignee: Anuj Modi
> Priority: Minor
> Labels: pull-request-available
> Fix For: 3.5.0
>
>
> In the merged pr [HADOOP-18869: [ABFS] Fixing Behavior of a File System APIs
> on root path by anujmodi2021 · Pull Request #6003 · apache/hadoop
> (github.com)|https://github.com/apache/hadoop/pull/6003], a config was
> switched-on: `fs.contract.test.root-tests-enabled`. This enables the root
> manipulation tests for the filesystem contract.
> Now, the execution of contract-tests in abfs works as per executionId
> integration-test-abfs-parallel-classes of the pom. The tests would work in
> different jvms, and at a given instance multiple such jvms could be there,
> depending on ${testsThreadCount}. The problem is that all the test jvms for
> contract-test use the same container for test runs which is defined by
> `fs.contract.test.fs.abfs`. Due to this, one jvm root-contract-runs can
> influence other jvm's root-contract-runs. This leads to CI failures for
> hadoop-azure package.
> Solution is to run these tests sequentially and separate from other
> commit/manifest tests.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
