On Sun, Oct 11, 2009 at 11:29:02AM -0400, Steve Lianoglou scratched on the wall:
> This row should have start=94622317, why is it inserting 94622320? > > I know the rtree documentation says that the index "does not normally > provide the exact answer," but I guess I'd be a bit surprised if this > is what is supposed to be happening. Is this expected behavior? Yes. RTrees use 32-bit floating point numbers. They have 23+1 bits of precision, which translates to about 7.2 base-10 significant digits. You're numbers are bigger, so you're starting to see rounding and clipping issues. Also see this discussion from a few days ago: http://www.mail-archive.com/sqlite-users%40sqlite.org/msg47004.html If you can use integers, there appears to be some undocumented methods to convert RTrees to integer indexes. -j -- Jay A. Kreibich < J A Y @ K R E I B I.C H > "Our opponent is an alien starship packed with atomic bombs. We have a protractor." "I'll go home and see if I can scrounge up a ruler and a piece of string." --from Anathem by Neal Stephenson _______________________________________________ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
