I think you missed Jenny's point. She was asking whether you could buffer up a hundred or a thousand (or more) items and index them all at once. This doesn't require that you go to the data store, just that you have a buffer that sticks around for a few minutes (or seconds from your apparent indexing rate).
On Sun, Aug 29, 2010 at 1:06 AM, Ron Ratovsky <r...@correlsense.com> wrote: > The indexing is done synchronously to saving the data. > Doing it asynchronously works slower since then the data to be indexed > needs > to be read from the data store, which is slower. > > On Thu, Aug 26, 2010 at 18:58, Jenny Brown <skyw...@gmail.com> wrote: > > > Do you index as you go along, or do you batch your updates to the > > index? Sometimes doing a large batch at once can improve total > > throughput, compared with singles. > > > > > > >
