Dear all, The author of the paper has answered. I think it would be good to provide him with all the feedback he needs to make justice to Octave in a future work. I am forwarding him the two results that were published here reproducing the results in the paper.
-- M. Sc. Juan Pablo Carbajal ----- PhD Student University of Zürich www.ailab.ch/carbajal 10 at 10:47 AM Subject: Re: [OctDev] A paper on evaluation of free mathematical software To: Juan Pablo Carbajal <carba...@ifi.uzh.ch> Dear Juan Pablo Carbajal, First of all, I would like to apologize for my delay in your e-mail. Secondly, I would like to thank you for your recommendations and notification about the comments on Octave’s development mailing list. About the outdated version of Octave I have to admit that our work took place months ago and as you observe this does not have to do only with Octave. Versions of other software are not the latest at this time but it was when our work completed. Moreover, about the online documentation, with online documentation we do not mean that there is no available manual or tutorials on the Internet. In contrast, we imply that there is not an online site with the syntax of function of Octave, like R or Scilab. Furthermore, in our evaluation tests we do not optimize the codes but we use the built-in functions of the software. I would like to ensure you that all the comments and recommendations are taken seriously into account and they will be included in our future work. Besides that, we would not hesitate to contact the software representatives in future for further advice and comments. Yours sincerely, Glavelis Themistoklis 2010/9/4 Juan Pablo Carbajal <carba...@ifi.uzh.ch> > > Dear Themistoklis Glavelis, > > Today there have been some activity in the Octave development mailing > list concerning your article "A computational evaluation of some free > mathematical software for scientific computing". Because I think you > may be interested in the comments I am forwarding you the latest > messages. > > I would like to remark that the latest version of octave is 3.2.4 > which is highly developed respect to the old 3.0.x > > Additionally I would like to point you to another software that is > emerging, Scipy http://www.scipy.org/ which are packages for python, > that combined with the interactive python shell (like ipython, for > example) creates an environment that is comparable to Octave and even > better in terms of extendibility (all python modules are available!) > and in terms of graphical outputs (through Matplotlib > http://matplotlib.sourceforge.net/). Maybe, if the paper is not yet > published you can add a section on this software package as well. > > > Thanks four your publication, it was time somebody took the work to > benchmark free software available. > > Sincerely, > > Juan Pablo > > > > ---------- Forwarded message ---------- > From: Martin Helm <mar...@mhelm.de> > Date: Sat, Sep 4, 2010 at 1:43 PM > Subject: Re: [OctDev] A paper on evaluation of free mathematical software > To: octave-dev@lists.sourceforge.net > > > Am Samstag, 4. September 2010, 13:22:36 schrieb Jaroslav Hajek: > > > Hmm, the Octave-related information is sadly outdated :( Probably > > still based on Octave 3.0.x. I believe 3.2.x would also perform better > > in the benchmarks. > > > In addition I have some severe doubts about the reliability of the tests, I > look through the table and found for a 2000x2000 matrix multiply > octave 18.664 > R 0.070 > Comparing the performance of a matrix multiply in R and octave does not give > me any hint that R outperforms (even the old 3.0 version of octave) by a > factor 266 (?!?) but gives comparable speed. > Looks like the testers did not recognize that a*b is not the same in octave > and R but that in R one has to write %*% for matrix multiplication and they > compare component wise multiplication in R with full matrix multiplication in > octave. > Not very promising from my point of view. > > - Martin > > ------------------------------------------------------------------------------ > This SF.net Dev2Dev email is sponsored by: > > Show off your parallel programming skills. > Enter the Intel(R) Threading Challenge 2010. > http://p.sf.net/sfu/intel-thread-sfd > _______________________________________________ > Octave-dev mailing list > Octave-dev@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/octave-dev > > > > -- > M. Sc. Juan Pablo Carbajal > ----- > PhD Student > University of Zürich > www.ailab.ch/carbajal > -- M. Sc. Juan Pablo Carbajal ----- PhD Student University of Zürich www.ailab.ch/carbajal ------------------------------------------------------------------------------ Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev _______________________________________________ Octave-dev mailing list Octave-dev@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/octave-dev