Re: [maven-failsafe-plugin] run suites in parallel using maven failsafe

[Tibor Digana]

This is the page where we describe the parallel execution for JUnit4
Maven Surefire Plugin – Fork Options and Parallel Test Execution
(apache.org)



and the source of this page can be found in
maven-surefire/fork-options-and-parallel-execution.apt.vm at master ·
apache/maven-surefire (github.com)



T


On Tue, Apr 13, 2021 at 9:27 PM V. Mark Lehky  wrote:

> I will not be able to look at this today, but I will hopefully get
> back to this within the next week.
>
> If I get this working, I definitely will be able to contribute back.
> Can you suggest where would be the best place to add docs about this?
>
> On Tue, 13 Apr 2021 at 00:40, Tibor Digana  wrote:
> >
> > Hi,
> >
> > threadCountSuites is related to JUnit4 Suite, see this:
> > https://github.com/junit-team/junit4/wiki/Aggregating-tests-in-suites
> >
> > threadCountClasses is related to the typical classes, see this example:
> > https://github.com/junit-team/junit4/wiki/Assertions
> >
> > Parallel packages do not exist, but you can make the same if you write a
> > Suite of Suites, example:
> > SuiteMainTest has (SuiteATest, SuiteBTest) where SuiteATest has
> > SomeStoryTest, AnotherStoryTest and SuiteBTest has DifferentStoryTest,
> > OtherStoryTest
> > and use this configuration parallel=suites, threadCountSuites=2,
> > test=SuiteMainTest.
> > This would work as you want to.
> >
> > It would nice to write an example in our documentation. If you want to
> > participate in the open source, you can open a pullrequest in GitHub.
> >
> >
> > Cheers
> > Tibor
> >
> > On Mon, Apr 12, 2021 at 8:48 PM V. Mark Lehky 
> wrote:
> >
> > > I am trying to run my tests in parallel, and I have a use-case
> > > different from all others that I have been able to find.
> > >
> > > My tests are laid out pretty straight-forward, something like the
> > > following:
> > >
> > > src/test/java/
> > > +-features.areaA
> > > | +-SomeStory.java
> > > | +-AnotherStory.java
> > > | ...
> > > +-features.areaB
> > > | +-DifferentStory.java
> > > | +-OtherStory.java
> > > | ...
> > > ...
> > >
> > > The tests are written using serenity-bdd, which is a wrapper for
> > > selenium, and the test manager is junit4.
> > >
> > > Each "area" represents some discreet area of the application under
> > > test. Tests within one area cannot run in parallel as they would
> > > clobber the data they are using. However, tests between different
> > > areas can certainly run in parallel as there are no collisions.
> > >
> > > I tried to configure my maven-failsafe-plugin according to the
> > > documentation (
> > >
> https://maven.apache.org/surefire/maven-failsafe-plugin/examples/fork-options-and-parallel-execution.html
> > > ).
> > > Using parallel=suites and any one of threadCount=4,
> > > threadCountSuites=4, or useUnlimitedThreads=true, results in only one
> > > test being run at a time.
> > >
> > > Is my understanding of "suites" wrong in the context of Failsafe
> > > plugin? Is it possible to parallelize tests so that entire packages
> > > are fed into VM threads one at a time, but classes within one package
> > > run sequentially?
> > >
> > > ty
> > >
> > > -
> > > To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
> > > For additional commands, e-mail: users-h...@maven.apache.org
> > >
> > >
>
> -
> To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
> For additional commands, e-mail: users-h...@maven.apache.org
>
>

Re: [maven-failsafe-plugin] run suites in parallel using maven failsafe

[V. Mark Lehky]

I will not be able to look at this today, but I will hopefully get
back to this within the next week.

If I get this working, I definitely will be able to contribute back.
Can you suggest where would be the best place to add docs about this?

On Tue, 13 Apr 2021 at 00:40, Tibor Digana  wrote:
>
> Hi,
>
> threadCountSuites is related to JUnit4 Suite, see this:
> https://github.com/junit-team/junit4/wiki/Aggregating-tests-in-suites
>
> threadCountClasses is related to the typical classes, see this example:
> https://github.com/junit-team/junit4/wiki/Assertions
>
> Parallel packages do not exist, but you can make the same if you write a
> Suite of Suites, example:
> SuiteMainTest has (SuiteATest, SuiteBTest) where SuiteATest has
> SomeStoryTest, AnotherStoryTest and SuiteBTest has DifferentStoryTest,
> OtherStoryTest
> and use this configuration parallel=suites, threadCountSuites=2,
> test=SuiteMainTest.
> This would work as you want to.
>
> It would nice to write an example in our documentation. If you want to
> participate in the open source, you can open a pullrequest in GitHub.
>
>
> Cheers
> Tibor
>
> On Mon, Apr 12, 2021 at 8:48 PM V. Mark Lehky  wrote:
>
> > I am trying to run my tests in parallel, and I have a use-case
> > different from all others that I have been able to find.
> >
> > My tests are laid out pretty straight-forward, something like the
> > following:
> >
> > src/test/java/
> > +-features.areaA
> > | +-SomeStory.java
> > | +-AnotherStory.java
> > | ...
> > +-features.areaB
> > | +-DifferentStory.java
> > | +-OtherStory.java
> > | ...
> > ...
> >
> > The tests are written using serenity-bdd, which is a wrapper for
> > selenium, and the test manager is junit4.
> >
> > Each "area" represents some discreet area of the application under
> > test. Tests within one area cannot run in parallel as they would
> > clobber the data they are using. However, tests between different
> > areas can certainly run in parallel as there are no collisions.
> >
> > I tried to configure my maven-failsafe-plugin according to the
> > documentation (
> > https://maven.apache.org/surefire/maven-failsafe-plugin/examples/fork-options-and-parallel-execution.html
> > ).
> > Using parallel=suites and any one of threadCount=4,
> > threadCountSuites=4, or useUnlimitedThreads=true, results in only one
> > test being run at a time.
> >
> > Is my understanding of "suites" wrong in the context of Failsafe
> > plugin? Is it possible to parallelize tests so that entire packages
> > are fed into VM threads one at a time, but classes within one package
> > run sequentially?
> >
> > ty
> >
> > -
> > To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
> > For additional commands, e-mail: users-h...@maven.apache.org
> >
> >

-
To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
For additional commands, e-mail: users-h...@maven.apache.org

Re: [maven-failsafe-plugin] run suites in parallel using maven failsafe

[Tibor Digana]

There are 3 suites in my example, so set threadCountSuites=3.

On Tue, Apr 13, 2021 at 9:39 AM Tibor Digana  wrote:

> Hi,
>
> threadCountSuites is related to JUnit4 Suite, see this:
> https://github.com/junit-team/junit4/wiki/Aggregating-tests-in-suites
>
> threadCountClasses is related to the typical classes, see this example:
> https://github.com/junit-team/junit4/wiki/Assertions
>
> Parallel packages do not exist, but you can make the same if you write a
> Suite of Suites, example:
> SuiteMainTest has (SuiteATest, SuiteBTest) where SuiteATest has
> SomeStoryTest, AnotherStoryTest and SuiteBTest has DifferentStoryTest,
> OtherStoryTest
> and use this configuration parallel=suites, threadCountSuites=2,
> test=SuiteMainTest.
> This would work as you want to.
>
> It would nice to write an example in our documentation. If you want to
> participate in the open source, you can open a pullrequest in GitHub.
>
>
> Cheers
> Tibor
>
> On Mon, Apr 12, 2021 at 8:48 PM V. Mark Lehky 
> wrote:
>
>> I am trying to run my tests in parallel, and I have a use-case
>> different from all others that I have been able to find.
>>
>> My tests are laid out pretty straight-forward, something like the
>> following:
>>
>> src/test/java/
>> +-features.areaA
>> | +-SomeStory.java
>> | +-AnotherStory.java
>> | ...
>> +-features.areaB
>> | +-DifferentStory.java
>> | +-OtherStory.java
>> | ...
>> ...
>>
>> The tests are written using serenity-bdd, which is a wrapper for
>> selenium, and the test manager is junit4.
>>
>> Each "area" represents some discreet area of the application under
>> test. Tests within one area cannot run in parallel as they would
>> clobber the data they are using. However, tests between different
>> areas can certainly run in parallel as there are no collisions.
>>
>> I tried to configure my maven-failsafe-plugin according to the
>> documentation (
>> https://maven.apache.org/surefire/maven-failsafe-plugin/examples/fork-options-and-parallel-execution.html
>> ).
>> Using parallel=suites and any one of threadCount=4,
>> threadCountSuites=4, or useUnlimitedThreads=true, results in only one
>> test being run at a time.
>>
>> Is my understanding of "suites" wrong in the context of Failsafe
>> plugin? Is it possible to parallelize tests so that entire packages
>> are fed into VM threads one at a time, but classes within one package
>> run sequentially?
>>
>> ty
>>
>> -
>> To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
>> For additional commands, e-mail: users-h...@maven.apache.org
>>
>>

Re: [maven-failsafe-plugin] run suites in parallel using maven failsafe

[Tibor Digana]

Hi,

threadCountSuites is related to JUnit4 Suite, see this:
https://github.com/junit-team/junit4/wiki/Aggregating-tests-in-suites

threadCountClasses is related to the typical classes, see this example:
https://github.com/junit-team/junit4/wiki/Assertions

Parallel packages do not exist, but you can make the same if you write a
Suite of Suites, example:
SuiteMainTest has (SuiteATest, SuiteBTest) where SuiteATest has
SomeStoryTest, AnotherStoryTest and SuiteBTest has DifferentStoryTest,
OtherStoryTest
and use this configuration parallel=suites, threadCountSuites=2,
test=SuiteMainTest.
This would work as you want to.

It would nice to write an example in our documentation. If you want to
participate in the open source, you can open a pullrequest in GitHub.


Cheers
Tibor

On Mon, Apr 12, 2021 at 8:48 PM V. Mark Lehky  wrote:

> I am trying to run my tests in parallel, and I have a use-case
> different from all others that I have been able to find.
>
> My tests are laid out pretty straight-forward, something like the
> following:
>
> src/test/java/
> +-features.areaA
> | +-SomeStory.java
> | +-AnotherStory.java
> | ...
> +-features.areaB
> | +-DifferentStory.java
> | +-OtherStory.java
> | ...
> ...
>
> The tests are written using serenity-bdd, which is a wrapper for
> selenium, and the test manager is junit4.
>
> Each "area" represents some discreet area of the application under
> test. Tests within one area cannot run in parallel as they would
> clobber the data they are using. However, tests between different
> areas can certainly run in parallel as there are no collisions.
>
> I tried to configure my maven-failsafe-plugin according to the
> documentation (
> https://maven.apache.org/surefire/maven-failsafe-plugin/examples/fork-options-and-parallel-execution.html
> ).
> Using parallel=suites and any one of threadCount=4,
> threadCountSuites=4, or useUnlimitedThreads=true, results in only one
> test being run at a time.
>
> Is my understanding of "suites" wrong in the context of Failsafe
> plugin? Is it possible to parallelize tests so that entire packages
> are fed into VM threads one at a time, but classes within one package
> run sequentially?
>
> ty
>
> -
> To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
> For additional commands, e-mail: users-h...@maven.apache.org
>
>

[maven-failsafe-plugin] run suites in parallel using maven failsafe

[V. Mark Lehky]

I am trying to run my tests in parallel, and I have a use-case
different from all others that I have been able to find.

My tests are laid out pretty straight-forward, something like the following:

src/test/java/
+-features.areaA
| +-SomeStory.java
| +-AnotherStory.java
| ...
+-features.areaB
| +-DifferentStory.java
| +-OtherStory.java
| ...
...

The tests are written using serenity-bdd, which is a wrapper for
selenium, and the test manager is junit4.

Each "area" represents some discreet area of the application under
test. Tests within one area cannot run in parallel as they would
clobber the data they are using. However, tests between different
areas can certainly run in parallel as there are no collisions.

I tried to configure my maven-failsafe-plugin according to the
documentation 
(https://maven.apache.org/surefire/maven-failsafe-plugin/examples/fork-options-and-parallel-execution.html).
Using parallel=suites and any one of threadCount=4,
threadCountSuites=4, or useUnlimitedThreads=true, results in only one
test being run at a time.

Is my understanding of "suites" wrong in the context of Failsafe
plugin? Is it possible to parallelize tests so that entire packages
are fed into VM threads one at a time, but classes within one package
run sequentially?

ty

-
To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
For additional commands, e-mail: users-h...@maven.apache.org