At 03:22 PM 10/31/2006, you wrote: >On the other hand, the excerpts from you and George which Steinar dug up >suggest that you were indeed trying to fix the boundaries at the point where >probability of roundoff error equalled the percentage time increase incurred >by using the next size of FFT.
No, Brian and I choose the boundary points such that a roundoff error would be rare but not impossible. The definition of rare was rather arbitrary based on extrapolation from experimental data. Why "rare" instead of "optimal"? Well, I don't want to be the one to tell someone he missed a prime because his run had a not-unexpected round off error. _______________________________________________ Prime mailing list [email protected] http://hogranch.com/mailman/listinfo/prime
