Re: [xwiki-devs] [STAMP/Test] Metrics we need to improve + strategy

2018-10-17 Thread Vincent Massol
> On 17 Oct 2018, at 15:54, Vincent Massol wrote: > > Hi, > >> On 17 Oct 2018, at 11:20, Vincent Massol wrote: >> >> Hi, >> >> [snip] >> >>> Process to run DSpot: >>> 1) Pick a module. Measure coverage and mutation score (or take the value >>> there already if they’re in the pom.xml).

Re: [xwiki-devs] [STAMP/Test] Metrics we need to improve + strategy

2018-10-17 Thread Vincent Massol
Hi, > On 17 Oct 2018, at 11:20, Vincent Massol wrote: > > Hi, > > [snip] > >> Process to run DSpot: >> 1) Pick a module. Measure coverage and mutation score (or take the value >> there already if they’re in the pom.xml). Same as for Descartes testing. >> 2) Run DSpot on the module, see >>

Re: [xwiki-devs] [STAMP/Test] Metrics we need to improve + strategy

2018-10-17 Thread Vincent Massol
Hi, [snip] > Process to run DSpot: > 1) Pick a module. Measure coverage and mutation score (or take the value > there already if they’re in the pom.xml). Same as for Descartes testing. > 2) Run DSpot on the module, see > https://massol.myxwiki.org/xwiki/bin/view/Blog/TestGenerationDspot for >

Re: [xwiki-devs] [STAMP/Test] Metrics we need to improve + strategy

2018-10-16 Thread Vincent Massol
Hi there, We need some more DSpot results. Would be great if you could help out. See below for instructions. > On 29 Aug 2018, at 11:20, Vincent Massol wrote: > > Hi devs (and anyone else interested to improve the tests of XWiki), > > History > == > > It all started when I analyzed our

Re: [xwiki-devs] [STAMP/Test] Metrics we need to improve + strategy

2018-09-04 Thread Vincent Massol
> On 29 Aug 2018, at 11:20, Vincent Massol wrote: [snip] > Objectives/KPIs/Metrics for STAMP > === > > The STAMP project has defined 9 KPIs that all partners (and thus XWiki) need > to work on: > > 1) K01: Increase test coverage > * Global increase by reducing by

Re: [xwiki-devs] [STAMP/Test] Metrics we need to improve + strategy

2018-09-04 Thread Vincent Massol
So we had a conf call this morning and we agreed to have TFD (Test Fixing Day) on Tuesdays for the XWiki 10.8 timeframe. Those who cannot attend on Tuesday will work on the tests during the other days to catch up. This means starting today! :) Thanks -Vincent > On 30 Aug 2018, at 12:27, Adel

Re: [xwiki-devs] [STAMP/Test] Metrics we need to improve + strategy

2018-09-03 Thread Simon Urli
OK for me too. Simon On 9/3/18 10:31 AM, Thomas Mortagne wrote: Sounds good. On Mon, Sep 3, 2018 at 9:55 AM, Vincent Massol wrote: On 3 Sep 2018, at 09:55, Vincent Massol wrote: I propose to do this tomorrow Tuesday, starting with an intro from me, using youtube live. Say, 10AM Paris

Re: [xwiki-devs] [STAMP/Test] Metrics we need to improve + strategy

2018-09-03 Thread Thomas Mortagne
Sounds good. On Mon, Sep 3, 2018 at 9:55 AM, Vincent Massol wrote: > >> On 3 Sep 2018, at 09:55, Vincent Massol wrote: >> >> I propose to do this tomorrow Tuesday, starting with an intro from me, using >> youtube live. > > Say, 10AM Paris time. > > Thanks > -Vincent > >> WDYT? >> >> Thanks >>

Re: [xwiki-devs] [STAMP/Test] Metrics we need to improve + strategy

2018-09-03 Thread Adel Atallah
+1 On Mon, Sep 3, 2018 at 9:55 AM, Vincent Massol wrote: > >> On 3 Sep 2018, at 09:55, Vincent Massol wrote: >> >> I propose to do this tomorrow Tuesday, starting with an intro from me, using >> youtube live. > > Say, 10AM Paris time. > > Thanks > -Vincent > >> WDYT? >> >> Thanks >> -Vincent

Re: [xwiki-devs] [STAMP/Test] Metrics we need to improve + strategy

2018-09-03 Thread Vincent Massol
> On 3 Sep 2018, at 09:55, Vincent Massol wrote: > > I propose to do this tomorrow Tuesday, starting with an intro from me, using > youtube live. Say, 10AM Paris time. Thanks -Vincent > WDYT? > > Thanks > -Vincent > >> On 30 Aug 2018, at 12:27, Adel Atallah wrote: >> >> Just to be

Re: [xwiki-devs] [STAMP/Test] Metrics we need to improve + strategy

2018-09-03 Thread Vincent Massol
I propose to do this tomorrow Tuesday, starting with an intro from me, using youtube live. WDYT? Thanks -Vincent > On 30 Aug 2018, at 12:27, Adel Atallah wrote: > > Just to be clear, when I proposed "having a whole day dedicated on > using these tools", I didn't meant having to have it every

Re: [xwiki-devs] [STAMP/Test] Metrics we need to improve + strategy

2018-08-30 Thread Adel Atallah
Just to be clear, when I proposed "having a whole day dedicated on using these tools", I didn't meant having to have it every week but only once, so we can properly start improving the tests. It would be some kind of training. On my side I don't think I'll be able to have on a week one day

Re: [xwiki-devs] [STAMP/Test] Metrics we need to improve + strategy

2018-08-30 Thread Vincent Massol
Hi, I don’t remember discussing this with you Thomas. Actually I’m not convinced to have a fixed day: * we already have a fixed BFD and having a second one doesn’t leave much flexibility for working on roadmap items when it’s the best * test sessions can be short (0.5-1 hours) and it’s easy to

Re: [xwiki-devs] [STAMP/Test] Metrics we need to improve + strategy

2018-08-30 Thread Thomas Mortagne
Indeed we discussed this but I don't see it in your mail Vincent. On Thu, Aug 30, 2018 at 10:33 AM, Adel Atallah wrote: > Hello, > > Maybe we should agree on having a whole day dedicated on using these > tools with a maximum number of developers. > That way we will be able to help each other and

Re: [xwiki-devs] [STAMP/Test] Metrics we need to improve + strategy

2018-08-30 Thread Adel Atallah
Hello, Maybe we should agree on having a whole day dedicated on using these tools with a maximum number of developers. That way we will be able to help each other and maybe it will make the process easier to carry out in the future. WDYT? Thanks, Adel On Wed, Aug 29, 2018 at 11:20 AM, Vincent