For serving, you might want to look at Apache Solr. It has replication and search over sharded indexes.
- 5 billion pages indexed and searchable. Dan Segel
- Re: 5 billion pages indexed and searchable. Stephen Watt
- Re: 5 billion pages indexed and searchable. Sharad Agarwal