Hello, flushing write buffer (term hashes) to disk is CPU intensive
operation, some part of it might be quite easy to move to GPUs (I think it
involves sorting). Other important part is encoding postings lists
(integers), it has been shown that SIMD instructions can be handy
I've been working on writing an indexer that runs in an FPGA. I find FPGAs
have a hard time doing functions that are very easy on a CPU. When I think
about it the same is true of GPUs. I want to propose some kind of
accelerator interface into the indexing code.
Here is a start to a proposal.