I've written a script that does bulk insertion from my database, it grabs chunks of 500 docs (out of 100 million ) and inserts them into solr over http. I have 5 threads that are inserting from a queue. After each insert I issue a commit. Every 20 or so inserts I get this error message: Error: Error opening new searcher. exceeded limit of maxWarmingSearchers=2, try again later.
I saw that people suggest to reduce the commit frequency to fix this. Is this really the way to need to fix this? The reason I was committing after every insert of 500 docs is so there would not be too much uncommmited data. -- - sent from my mobile
