Testing of packages

2012-04-27 Thread Matthias Runge
Hi, just a half-baked idea, I'm carrying some time with me around. Some packages have a check-section being executed during build. Would it make sense to execute that test, when required packages of that package get updated (to see, if the update breaks my package)? (Or other way around: when

Re: Testing of packages

2012-04-27 Thread Michael Schwendt
On Fri, 27 Apr 2012 12:10:11 +0200, MR (Matthias) wrote: Hi, just a half-baked idea, I'm carrying some time with me around. Some packages have a check-section being executed during build. Would it make sense to execute that test, when required packages of that package get updated (to

Re: Testing of packages

2012-04-27 Thread Matthias Runge
On 27/04/12 12:37, Michael Schwendt wrote: Hardly any %check section uses installed files. Typically, files in the buildroot are used, or files plus test data in the builddir. Test data won't be available. We encourage our packagers to implement useful check-sections. To make an example,

Re: Testing of packages

2012-04-27 Thread Michael Schwendt
On Fri, 27 Apr 2012 13:04:56 +0200, MR (Matthias) wrote: On 27/04/12 12:37, Michael Schwendt wrote: Hardly any %check section uses installed files. Typically, files in the buildroot are used, or files plus test data in the builddir. Test data won't be available. We encourage our

Re: Testing of packages

2012-04-27 Thread Matthias Runge
On 27/04/12 13:57, Michael Schwendt wrote: A wrong approach? Why do you insist on using the %check section for that? It's a build-time feature, found only in the spec file and not packaged in the built rpms (also due to the test data I've referred to above). I'm asking if the scripts from

Re: Testing of packages

2012-04-27 Thread Ralf Corsepius
On 04/27/2012 02:11 PM, Matthias Runge wrote: I wonder how different a run-time test-suite dffers from a test suite to be executed during build. There are 2 major differences: 1. The package-to-test itself is not installed to its final destination. 2. A testsuite being run in %check has

Re: Testing of packages

2012-04-27 Thread Matthias Clasen
On Fri, 2012-04-27 at 14:33 +0200, Ralf Corsepius wrote: Apart of this, there are test-cases, which can not be/can not be easily executed inside of a mock-environment as part of building. Not to mention that running extensive test suites for every build will put strain on our build

Re: Testing of packages

2012-04-27 Thread Thomas Spura
On Fri, Apr 27, 2012 at 3:26 PM, Matthias Clasen mcla...@redhat.com wrote: On Fri, 2012-04-27 at 14:33 +0200, Ralf Corsepius wrote: Apart of this, there are test-cases, which can not be/can not be easily executed inside of a mock-environment as part of building. Not to mention that running

Re: Testing of packages

2012-04-27 Thread Kamil Paral
On Fri, Apr 27, 2012 at 3:26 PM, Matthias Clasen mcla...@redhat.com wrote: On Fri, 2012-04-27 at 14:33 +0200, Ralf Corsepius wrote: Apart of this, there are test-cases, which can not be/can not be easily executed inside of a mock-environment as part of building. Not to mention

Re: Testing of packages

2012-04-27 Thread Adam Williamson
On Fri, 2012-04-27 at 15:30 +0200, Thomas Spura wrote: On Fri, Apr 27, 2012 at 3:26 PM, Matthias Clasen mcla...@redhat.com wrote: On Fri, 2012-04-27 at 14:33 +0200, Ralf Corsepius wrote: Apart of this, there are test-cases, which can not be/can not be easily executed inside of a