On Sun, 5 Sep 2021 20:41:08 +0200 Ichthyostega <p...@ichthyostega.de> wrote:
> > >Hi Will, >Hi Kristian, > >with my testing effort, today I have reached the next milestone: >A simple test case can now detect minor sonic differences. >Moreover the handling of sound files is complete, and in >so called "baseline mode" the Testrunner can now capture >baseline waveforms, which are used in future to compare the >test results in future to possibly detect further differences. > >Moreover, a usable first version of the collecting and reporting >of test results is also available now. > > >Next steps will be to come up with a concept how to deal with timing >measurements (we need to factor out some kind of "Platform Factor"). >And we need to ensure a consistent startup configuration, like e.g. >control the oscil size and buffer size from the test setup. > >-- Hermann > > > >Example-Session >Detecting a difference... > >>> (hiv)~/devel/a/zyntest-$ ./run-tests testsuite >> ---------------------------------------- >> # Yoshimi-Testsuite >> >> Running: HelloWorld.test >> Warn: Minor differences against baseline; peak Δ -102.411dB(RMS) >> ---------------------------------------- >> Performed *1* test cases. >> ---------------------------------------- >> **Warnings**: 1 >> **Failures**: 0 >> - "HelloWorld.test": Performed; detect Δ -102.411dB(RMS) >> ---------------------------------------- >> *YELLOW* > > >Capture a new baseline... > >>> (hiv)~/devel/a/zyntest-$ ./run-tests testsuite --baseline >> ---------------------------------------- >> # Yoshimi-Testsuite >> >> +++ *Baseline capturing mode* +++ >> >> >> Running: HelloWorld.test >> Warn: Minor differences against baseline; peak Δ -102.411dB(RMS) >> Warn: Store HelloWorld-baseline.wav >> ---------------------------------------- >> Performed *1* test cases. >> ---------------------------------------- >> **Warnings**: 2 >> **Failures**: 0 >> - "HelloWorld.test": Performed; detect Δ -102.411dB(RMS) >> ---------------------------------------- >> *YELLOW* > > >Test GREEN again > >>> (hiv)~/devel/a/zyntest-$ ./run-tests testsuite >> ---------------------------------------- >> # Yoshimi-Testsuite >> >> Running: HelloWorld.test >> ---------------------------------------- >> Performed *1* test cases. >> ---------------------------------------- >> *GREEN* Pleased to see progress on this. Is the code ready enough for us to look at and try? (preferably with an idiots guide) -- Will J Godfrey https://willgodfrey.bandcamp.com/ http://yoshimi.github.io Say you have a poem and I have a tune. Exchange them and we can both have a poem, a tune, and a song. _______________________________________________ Yoshimi-devel mailing list Yoshimi-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/yoshimi-devel
