Is that 800MB/s sustained? Is it constant, 24/7? Or is it bursty data?
If it's bursty, you could buffer the inserts in an append only log.
Insertion to the SQL(ite) database can be done asynchronously. Writing
to unstructured, append only log files can be done at pretty much disk
I/O speed.
If it's not bursty, but sustained, then I fear SQLite or any other
database will not be able to match that rate. You'll probably run out
of CPU before running out of disk IO.
Christian
PS. On a side note, is it wise still buying SGI kit?
That's a sustained rate. I can stall the hardware, though, when needed.
It just makes things take longer to not take full advantage of the
hardware. Concerning SGI, I keep hoping their prices will drop to match
their stock. I actually think they could turn things around if they
dropped their prices. They're going to have a tough time competing with
the Cray XD1 and the IBM Blue Gene unless they are way cheaper. SGI's
choice to go with the Itanium may prove fatal. I think they had better
jump to an x64 platform soon.
