> >> Even if "commit" takes 20 minutes? > I've never seen a commit take 20 minutes... (anything taking that long > is broken, perhaps in concept)
"index merge" can take from few minutes to few hours. That's why nothing can beat SOLR Master/Slave and sharding for huge datasets. And reopening of IndexReader after each commit may take at least few seconds (although depends on usage patterns). "IndexReader or IndexSearcher will only see the index as of the "point in time" that it was opened. Any changes committed to the index after the reader was opened are not visible until the reader is re-opened." I am wondering how Compass opens new instance of IndexReader (after each commit!) - is it really implemented? I can't believe! It will work probably fine for small datasets (less than 100k), and 1 TPD (transaction-per-day)... Very expensive and unnatural ACID... -Fuad
