Chris Foote wrote: > Does anyone know of a fast hash module which is more optimal for > large datasets ? > > p.s. Disk-based DBs are out of the question because most key lookups > will result in a miss, and lookup time is critical for this application.
In memory sqlite database (use ':memory:' as the filename) with appropriate indexes? Make sure you put any inserts into a transaction. Using a disk based database, inserting 10,000 rows went from being a multi-minute operation to a split-second operation, just by putting them inside a BEGIN/COMMIT. Cheers D
signature.asc
Description: OpenPGP digital signature
_______________________________________________ sapug mailing list [email protected] http://mail.python.org/mailman/listinfo/sapug
