Re: [Piglit] Newbie question: command to run tests that passed before?

2016-09-07 Thread Rob Clark
On Wed, Sep 7, 2016 at 6:59 PM, Dan Kegel wrote: > Hi! > I'd like to use piglit as a regression test for my opengl test rigs. > My plan is to run piglit a few times on each OS/card combo I need to support, > get a list of tests that reliably pass on each platform, and then >

Re: [Piglit] Newbie question: command to run tests that passed before?

2016-09-07 Thread Dylan Baker
Quoting Dylan Baker (2016-09-07 16:23:43) > Quoting Dan Kegel (2016-09-07 15:59:21) > > Hi! > > I'd like to use piglit as a regression test for my opengl test rigs. > > My plan is to run piglit a few times on each OS/card combo I need to > > support, > > get a list of tests that reliably pass on

Re: [Piglit] Newbie question: command to run tests that passed before?

2016-09-07 Thread Dylan Baker
Quoting Mark Janes (2016-09-07 16:24:11) > Piglit converts "known failing" tests to a "skip" status. This is only true of the JUnit backend. I've never bothered to get that working with the default JSON backend. Its on my list of things to do, just not very high up on that list. Dylan

Re: [Piglit] Newbie question: command to run tests that passed before?

2016-09-07 Thread Dylan Baker
Quoting Dan Kegel (2016-09-07 16:10:46) > Hrm. A solution that involved Jenkins would be way overkill. > I'm just looking for the little core idiom for running just the > test of tests that passed in the, um, past. > > Maybe that's not the way people do it? Does everyone just compare > logs

Re: [Piglit] Newbie question: command to run tests that passed before?

2016-09-07 Thread Mark Janes
Dan Kegel writes: > Hrm. A solution that involved Jenkins would be way overkill. > I'm just looking for the little core idiom for running just the > test of tests that passed in the, um, past. Even if you don't want to set up a CI with jenkins, you can refer to the automation

Re: [Piglit] Newbie question: command to run tests that passed before?

2016-09-07 Thread Dylan Baker
Quoting Dan Kegel (2016-09-07 15:59:21) > Hi! > I'd like to use piglit as a regression test for my opengl test rigs. > My plan is to run piglit a few times on each OS/card combo I need to support, > get a list of tests that reliably pass on each platform, and then > forevermore run just those

Re: [Piglit] Newbie question: command to run tests that passed before?

2016-09-07 Thread Dan Kegel
Hrm. A solution that involved Jenkins would be way overkill. I'm just looking for the little core idiom for running just the test of tests that passed in the, um, past. Maybe that's not the way people do it? Does everyone just compare logs against old logs? Thanks, and say hi to Ethyl for me.

Re: [Piglit] Newbie question: command to run tests that passed before?

2016-09-07 Thread Ilia Mirkin
[+janesma] Mark has set up a CI system at Intel, and I'm fairly sure did a writeup about it and shared code, but I can't for the life of me remember the details. Maybe a few Guinesses ago, but definitely not now... hopefully he can share. [It involves Jenkins.] -ilia On Wed, Sep 7, 2016 at

[Piglit] Newbie question: command to run tests that passed before?

2016-09-07 Thread Dan Kegel
Hi! I'd like to use piglit as a regression test for my opengl test rigs. My plan is to run piglit a few times on each OS/card combo I need to support, get a list of tests that reliably pass on each platform, and then forevermore run just those tests. I know about the -t and -x options, and the