On 06/04/2017 19:53, Paul Rogers wrote: > In evaluating the tests, the book makes reference to: > http://download.java.net/openjdk/testresults/8/ > > However, that page is updated regularly, with every build they make, > at the moment 152, so is virtually useless for comparison. May I > suggest/request the book include the test results relevant at the > time, a particular version is chosen? >
This page is the best (to my knowledge) comparison we can have. It's updated because it follows development, but the book only includes official releases (a new one should be coming soon according to [1]). So it may be out of date, but I'd say it's better than nothing. As of your request, it makes no sense that the maintainer of the java page publish his test results. A point does not make statistics... Also, I do not have always the time (or the will) to sort out all the test failures. Last time I run the tests, I had consistently more than 50 errors, all in the same area, so I think it was more of a problem with my configuration than with the package. And all in all, it was just 50 out of more than 6,000. So what would be the value of publishing those tests results? At least, the referenced page may be used to see whether some failures may be considered as "known"... I may change the wording to something like `Upstream runs the tests regularly, so you may want to look at these "test results (link)". Those results may show which tests can be considered as "expected to fail", but may differ from yours since they are not run on exactly the same sources.' Also I think we have put too much emphasis on tests in the book at a certain time. It was a waste of time, because tests more often reflect upstream inability to fix things than something going really wrong. And it is very unlikely that a particular test show something wrong in a build. Of course, more that 10-20 % of failures should warn about something possibly going wrong, but only "possibly". The present editors team is doing much better in this respect. Regards Pierre [1] https://www.oracle.com/technetwork/topics/security/alerts-086861.html -- http://lists.linuxfromscratch.org/listinfo/blfs-support FAQ: http://www.linuxfromscratch.org/blfs/faq.html Unsubscribe: See the above information page
