On Mon, 2010-06-21 at 15:21 +0300, Uri Savoray wrote: > So, how long does it take you now to search these tables for a single key? > With what type of hardware?
The limiting factor for lookups will be IOPS of your storage hardware. Looking up a single 114 bits burst in 40 tables, requires 51*8*40 = 16320 read operations. A stack of 10 rotating hard drives will need 16.3 seconds (@ 100 IOPS pr drive ) - SSD storage will bring about a tenfold increase in speed and cost roughly. 2-3 burst worth of data will on average be needed to recover a single key, bringing the total lookup time to 40-50 seconds on a stack of spinning disks. The code for doing this is still at an experimental stage, and much design work needs to be done. Using Native Command Queues (NCQ) for instance can bring a boost to the lookup, and needs to be thought about when doing the software architecture. Frank _______________________________________________ A51 mailing list [email protected] http://lists.lists.reflextor.com/cgi-bin/mailman/listinfo/a51
