Hi Will,
Hi Kristian,

with my testing effort, today I have reached the next milestone:
A simple test case can now detect minor sonic differences.
Moreover the handling of sound files is complete, and in
so called "baseline mode" the Testrunner can now capture
baseline waveforms, which are used in future to compare the
test results in future to possibly detect further differences.

Moreover, a usable first version of the collecting and reporting
of test results is also available now.


Next steps will be to come up with a concept how to deal with timing
measurements (we need to factor out some kind of "Platform Factor").
And we need to ensure a consistent startup configuration, like e.g.
control the oscil size and buffer size from the test setup.

-- Hermann



Example-Session
Detecting a difference...

(hiv)~/devel/a/zyntest-$ ./run-tests testsuite
----------------------------------------
# Yoshimi-Testsuite

Running: HelloWorld.test
Warn: Minor differences against baseline; peak Δ -102.411dB(RMS)
----------------------------------------
Performed *1* test cases.
----------------------------------------
**Warnings**: 1
**Failures**: 0
- "HelloWorld.test": Performed; detect Δ -102.411dB(RMS)
----------------------------------------
*YELLOW*


Capture a new baseline...

(hiv)~/devel/a/zyntest-$ ./run-tests testsuite --baseline
----------------------------------------
# Yoshimi-Testsuite

+++ *Baseline capturing mode* +++


Running: HelloWorld.test
Warn: Minor differences against baseline; peak Δ -102.411dB(RMS)
Warn: Store HelloWorld-baseline.wav
----------------------------------------
Performed *1* test cases.
----------------------------------------
**Warnings**: 2
**Failures**: 0
- "HelloWorld.test": Performed; detect Δ -102.411dB(RMS)
----------------------------------------
*YELLOW*


Test GREEN again

(hiv)~/devel/a/zyntest-$ ./run-tests testsuite
----------------------------------------
# Yoshimi-Testsuite

Running: HelloWorld.test
----------------------------------------
Performed *1* test cases.
----------------------------------------
*GREEN*




_______________________________________________
Yoshimi-devel mailing list
Yoshimi-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/yoshimi-devel

Reply via email to