[
https://issues.apache.org/jira/browse/HADOOP-18508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-18508:
------------------------------------
Description:
It is now possible to provide a job ID in the maven "job.id" property
hadoop-aws test runs to isolate paths under a the test bucket
under which all tests will be executed.
This will allow independent builds *in different source trees*
to test against the same bucket in parallel, and is designed for
CI testing.
Example:
mvn verify -Dparallel-tests -Droot.tests.enabled=false -Djob.id=1
mvn verify -Droot.tests.enabled=false -Djob.id=2
- Root tests must be be disabled to stop them cleaning up
the test paths of other test runs.
- Do still regularly run the root tests just to force cleanup
of the output of any interrupted test suites.
was:
to have (internal, sorry) jenkins test runs work in parallel, they need to
share the same bucket so
# must have a prefix for job id which is passed in to the path used for forks
# support disabling root tests so they don't stamp on each other
> support multiple s3a integration test runs on same bucket in parallel
> ---------------------------------------------------------------------
>
> Key: HADOOP-18508
> URL: https://issues.apache.org/jira/browse/HADOOP-18508
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3, test
> Affects Versions: 3.3.9
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Minor
> Labels: pull-request-available
> Fix For: 3.5.0, 3.4.1
>
>
> It is now possible to provide a job ID in the maven "job.id" property
> hadoop-aws test runs to isolate paths under a the test bucket
> under which all tests will be executed.
> This will allow independent builds *in different source trees*
> to test against the same bucket in parallel, and is designed for
> CI testing.
> Example:
> mvn verify -Dparallel-tests -Droot.tests.enabled=false -Djob.id=1
> mvn verify -Droot.tests.enabled=false -Djob.id=2
> - Root tests must be be disabled to stop them cleaning up
> the test paths of other test runs.
> - Do still regularly run the root tests just to force cleanup
> of the output of any interrupted test suites.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
