On 03.06.2012, at 21:45, Sergei Steshenko wrote: > ----- Original Message ----- >> From: Lukas Reichlin <lukas.reichlin.li...@gmail.com> >> To: Octave Forge <octave-dev@lists.sourceforge.net>; Carnë Draug >> <carandraug+...@gmail.com> >> Cc: help-octave <help-oct...@octave.org> >> Sent: Sunday, June 3, 2012 6:11 PM >> Subject: control-2.3.51 released in package forum - please upload >> >> Hi all, >> >> I've just posted control-2.3.51 (SVN Revision 10559) in the package forum >> [1]. Please upload it to the server. The changes are listed in the NEWS file >> [2]. >> >> The notice for >> http://octave.sourceforge.net/ >> >> >> June 3, 2012 >> >> control-2.3.51 released >> >> >> >> Best regards >> Lukas >> >> [1] >> http://sourceforge.net/apps/phpbb/octave/viewforum.php?f=1 >> >> [2] >> http://octave.svn.sourceforge.net/viewvc/octave/trunk/octave-forge/main/control/NEWS?revision=10559&view=markup >> > > Hello, > > in the changelog among other things I've read the following: > > " > Add a few remarks to the help text regarding the severity of failing tests. > ". > > Please see my test failures below - do they mean my linear algebra stuff > (e.g. ATLAS) is defective ? > > Thanks, > Sergei. > > octave:2> test_control > ***** assert (ac, ac_e, 1e-4); > !!!!! test failed > assert (ac,ac_e,1e-4) expected > 0.00000 0.00000 0.00000 0.00000 -1.26270 0.43340 0.46660 > 0.00000 2.00000 0.00000 -3.74170 -0.85200 0.29240 -0.43420 > 0.00000 0.00000 1.78620 0.37800 -0.26510 -0.77230 0.00000 > 0.00000 0.00000 0.00000 3.74170 0.85200 -0.29240 0.43420 > 0.00000 0.00000 0.00000 0.00000 -1.55400 0.53340 0.57420 > 0.00000 0.00000 0.00000 0.00000 -0.65330 0.22420 0.24140 > 0.00000 0.00000 0.00000 0.00000 -0.58920 0.20220 0.21770 > but got > 0.00000 0.00000 -0.00000 0.00000 -1.41132 -0.00509 -0.09025 > 0.00000 2.00000 0.00000 -3.74166 -0.70600 -0.70821 0.00000 > 0.00000 0.00000 1.78619 0.37796 0.05219 -0.05202 -0.81316 > 0.00000 0.00000 0.00000 3.74166 0.70600 0.70821 -0.00000 > 0.00000 0.00000 0.00000 0.00000 1.98980 0.00718 0.12724 > 0.00000 0.00000 0.00000 0.00000 0.01122 0.00004 0.00072 > 0.00000 0.00000 0.00000 0.00000 0.15568 0.00056 0.00996 > maximum absolute error 3.5438 exceeds tolerance 0.0001 > PASSES 5 out of 5 tests > PASSES 3 out of 3 tests > PASSES 5 out of 5 tests > PASSES 1 out of 1 tests > PASSES 1 out of 1 tests > ***** assert (Ar, Ae, 1e-4); > !!!!! test failed > assert (Ar,Ae,1e-4) expected > 1.00000 -0.03930 -0.09800 -0.10660 0.07810 -0.23300 0.07770 > 0.00000 1.03120 0.27170 0.26090 -0.15330 0.67580 -0.35530 > 0.00000 0.00000 1.38870 0.66990 -0.42810 1.63890 -0.76150 > 0.00000 0.00000 0.00000 -1.21470 0.24230 -0.97920 0.47880 > 0.00000 0.00000 0.00000 0.00000 -1.05450 0.50350 -0.27880 > 0.00000 0.00000 0.00000 0.00000 0.00000 1.63550 -0.43230 > 0.00000 0.00000 0.00000 0.00000 0.00000 0.00000 1.00000 > but got > 1.00000 0.03935 0.09802 -0.10656 0.07805 -0.23302 0.07773 > 0.00000 1.03122 0.27169 -0.26093 0.15327 -0.67578 0.35529 > 0.00000 0.00000 1.38869 -0.66991 0.42806 -1.63894 0.76153 > 0.00000 0.00000 0.00000 1.21467 -0.24232 0.97919 -0.47884 > 0.00000 0.00000 0.00000 0.00000 1.05454 -0.50348 0.27881 > 0.00000 0.00000 0.00000 0.00000 0.00000 1.63547 -0.43234 > 0.00000 0.00000 0.00000 0.00000 0.00000 0.00000 1.00000 > maximum absolute error 3.27784 exceeds tolerance 0.0001 > shared variables > scalar structure containing the fields: > > Ar = > > 1.00000 0.03935 0.09802 -0.10656 0.07805 -0.23302 0.07773 > 0.00000 1.03122 0.27169 -0.26093 0.15327 -0.67578 0.35529 > 0.00000 0.00000 1.38869 -0.66991 0.42806 -1.63894 0.76153 > 0.00000 0.00000 0.00000 1.21467 -0.24232 0.97919 -0.47884 > 0.00000 0.00000 0.00000 0.00000 1.05454 -0.50348 0.27881 > 0.00000 0.00000 0.00000 0.00000 0.00000 1.63547 -0.43234 > 0.00000 0.00000 0.00000 0.00000 0.00000 0.00000 1.00000 > > Br = > > -5.5968e-01 2.3631e-01 > 4.8427e-01 4.9770e-02 > 4.7273e-01 1.4915e-01 > -1.8019e-01 -1.1574e+00 > -5.9948e-01 -1.5560e-01 > -1.7294e-01 -3.9991e-01 > 1.1147e-17 2.5000e-01 > > Cr = > > 0.00000 0.00000 0.00000 0.00000 0.00000 0.00000 4.00000 > 0.00000 0.00000 0.00000 0.00000 0.00000 3.15238 -1.75000 > > Dr = > > 0 0 > 0 0 > > Er = > 0.40999 -0.25895 -0.50798 -0.31085 0.07054 0.14290 -0.14769 > 0.76292 -0.34645 0.09918 0.30065 -0.06189 -0.24831 0.01523 > -0.11198 -0.21245 -0.41840 0.12877 -0.05690 0.42134 0.61817 > 0.00000 0.11215 -0.00387 -0.27713 0.07584 -0.09747 -0.39231 > 0.00000 0.00000 0.37082 0.42899 -0.10064 -0.14015 0.26995 > 0.00000 0.00000 0.00000 0.00000 0.94581 -0.22115 0.23779 > 0.00000 0.00000 0.00000 0.57107 0.26478 0.59479 -0.50000 > > Ae = > > 1.00000 -0.03930 -0.09800 -0.10660 0.07810 -0.23300 0.07770 > 0.00000 1.03120 0.27170 0.26090 -0.15330 0.67580 -0.35530 > 0.00000 0.00000 1.38870 0.66990 -0.42810 1.63890 -0.76150 > 0.00000 0.00000 0.00000 -1.21470 0.24230 -0.97920 0.47880 > 0.00000 0.00000 0.00000 0.00000 -1.05450 0.50350 -0.27880 > 0.00000 0.00000 0.00000 0.00000 0.00000 1.63550 -0.43230 > 0.00000 0.00000 0.00000 0.00000 0.00000 0.00000 1.00000 > > Be = > > -0.55970 0.23630 > -0.48430 -0.04980 > -0.47270 -0.14910 > 0.18020 1.15740 > 0.59950 0.15560 > -0.17290 -0.39990 > 0.00000 0.25000 > > Ce = > > 0.00000 0.00000 0.00000 0.00000 0.00000 0.00000 4.00000 > 0.00000 0.00000 0.00000 0.00000 0.00000 3.15240 -1.75000 > > De = > > 0 0 > 0 0 > > Ee = > > 0.41000 0.25900 0.50800 -0.31090 0.07050 0.14290 -0.14770 > -0.76290 -0.34640 0.09920 -0.30070 0.06190 0.24830 -0.01520 > 0.11200 -0.21240 -0.41840 -0.12880 0.05690 -0.42130 -0.61820 > 0.00000 0.11220 -0.00390 0.27710 -0.07580 0.09750 0.39230 > 0.00000 0.00000 0.37080 -0.42900 0.10060 0.14020 -0.26990 > 0.00000 0.00000 0.00000 0.00000 0.94580 -0.22110 0.23780 > 0.00000 0.00000 0.00000 0.57110 0.26480 0.59480 -0.50000 > > PASSES 1 out of 1 tests > PASSES 4 out of 4 tests > PASSES 1 out of 1 tests > PASSES 22 out of 22 tests > PASSES 12 out of 12 tests > PASSES 8 out of 8 tests > PASSES 2 out of 2 tests > PASSES 2 out of 2 tests > PASSES 27 out of 27 tests > PASSES 7 out of 7 tests > PASSES 3 out of 3 tests > PASSES 3 out of 3 tests > PASSES 4 out of 4 tests > PASSES 2 out of 2 tests > PASSES 5 out of 5 tests > PASSES 3 out of 3 tests > PASSES 3 out of 3 tests > ***** assert (Mo, Me, 1e-4); > !!!!! test failed > assert (Mo,Me,1e-4) expected > > 1.27290 0.00000 6.59470 0.00000 -3.42290 0.13310 -0.13310 > 0.00000 0.81690 0.00000 2.48210 0.00000 -0.08620 -0.08620 > -2.98890 0.00000 -2.90280 0.00000 -0.36920 -2.67770 2.67770 > 0.00000 -3.39210 0.00000 -3.11260 0.00000 -3.57670 -3.57670 > -1.47670 0.00000 -2.03390 0.00000 -0.61070 -2.30330 2.30330 > -0.69070 -0.68820 0.07790 0.09580 -0.00380 0.00000 0.00000 > 0.06760 0.00000 0.65320 0.00000 -0.75220 0.00000 0.00000 > 0.69070 -0.68820 -0.07790 0.09580 0.00380 0.00000 0.00000 > but got > 1.27295 0.00000 -6.59466 0.00000 -3.42287 -0.13307 0.13307 > -0.00000 0.81688 0.00000 2.48210 0.00000 0.08620 0.08620 > 2.98890 -0.00000 -2.90283 0.00000 0.36919 -2.67775 2.67775 > -0.00000 -3.39208 -0.00000 -3.11263 -0.00000 3.57669 3.57669 > -1.47666 0.00000 2.03393 -0.00000 -0.61070 2.30328 -2.30328 > 0.69073 0.68823 0.07791 -0.09576 0.00376 0.00000 0.00000 > -0.06755 -0.00000 0.65316 -0.00000 0.75223 0.00000 0.00000 > -0.69073 0.68823 -0.07791 -0.09576 -0.00376 0.00000 0.00000 > maximum absolute error 13.1894 exceeds tolerance 0.0001 > shared variables > scalar structure containing the fields: > > Mo = > > 1.27295 0.00000 -6.59466 0.00000 -3.42287 -0.13307 0.13307 > -0.00000 0.81688 0.00000 2.48210 0.00000 0.08620 0.08620 > 2.98890 -0.00000 -2.90283 0.00000 0.36919 -2.67775 2.67775 > -0.00000 -3.39208 -0.00000 -3.11263 -0.00000 3.57669 3.57669 > -1.47666 0.00000 2.03393 -0.00000 -0.61070 2.30328 -2.30328 > 0.69073 0.68823 0.07791 -0.09576 0.00376 0.00000 0.00000 > -0.06755 -0.00000 0.65316 -0.00000 0.75223 0.00000 0.00000 > -0.69073 0.68823 -0.07791 -0.09576 -0.00376 0.00000 0.00000 > > Me = > > 1.27290 0.00000 6.59470 0.00000 -3.42290 0.13310 -0.13310 > 0.00000 0.81690 0.00000 2.48210 0.00000 -0.08620 -0.08620 > -2.98890 0.00000 -2.90280 0.00000 -0.36920 -2.67770 2.67770 > 0.00000 -3.39210 0.00000 -3.11260 0.00000 -3.57670 -3.57670 > -1.47670 0.00000 -2.03390 0.00000 -0.61070 -2.30330 2.30330 > -0.69070 -0.68820 0.07790 0.09580 -0.00380 0.00000 0.00000 > 0.06760 0.00000 0.65320 0.00000 -0.75220 0.00000 0.00000 > 0.69070 -0.68820 -0.07790 0.09580 0.00380 0.00000 0.00000 > > Info = > > scalar structure containing the fields: > > n = 7 > ns = 7 > hsv = > > 0.880263 > 0.850619 > 0.803778 > 0.449390 > 0.397312 > 0.021408 > 0.020850 > > nu = 0 > nr = 5 > > HSVe = > > 0.880300 > 0.850600 > 0.803800 > 0.449400 > 0.397300 > 0.021400 > 0.020900 > > PASSES 2 out of 2 tests > PASSES 2 out of 2 tests > PASSES 2 out of 2 tests > PASSES 2 out of 2 tests > PASSES 2 out of 2 tests > PASSES 1 out of 1 tests > PASSES 4 out of 4 tests > PASSES 1 out of 1 tests > PASSES 4 out of 4 tests > PASSES 1 out of 1 tests > PASSES 4 out of 4 tests > PASSES 2 out of 2 tests > PASSES 30 out of 30 tests > PASSES 2 out of 2 tests > PASSES 1 out of 1 tests > PASSES 2 out of 2 tests > octave:3>
I would not call your ATLAS defective. For various reasons, results from ATLAS and Reference BLAS/LAPACK can differ. Remember that ATLAS stands for _Automatically_ _Tuned_ Linear Algebra Software :-) Your results from the failing tests are probably not wrong: Just compare the observed and the expected state-space models. There are several ways to do this: - poles and zeros should be the same - Hankel singular values should be the same - plots from time and frequency responses look the same - solve the equations below for the diagonal transformation matrix T, its entries should be -1 and 1. (Because in your example, the absolute values are the same) Aexp = T \ Aobs * T Bexp = T \ Bobs Cexp = Cobs * T To sum up: if there is a state transformation between observed and expected model, your results are correct. Remember that the SLICOT authors recommend reference BLAS/LAPACK and use it for their test cases (which I use for test_control). If confidence in correct results is more important to you than a few milliseconds speed advantage from automatic tuning, then you should follow their advice. Hope this helps, Lukas ------------------------------------------------------------------------------ Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ _______________________________________________ Octave-dev mailing list Octave-dev@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/octave-dev
