Re: Understanding flush and DocumentsWriterPerThread

2017-08-06 Thread Nawab Zada Asad Iqbal
I think I am hitting this problem. Since, maxIndexingThreads is not used anymore, i see 330+ indexing threads (in the attached log:- "334 in-use non-flushing threads states" ) The bugfix recommends using custom code to control concurrency in IndexWriter, how can I configure it using solr6.6 ?

Understanding flush and DocumentsWriterPerThread

2017-08-05 Thread Nawab Zada Asad Iqbal
Hi, I am debugging a bulk indexing performance issue while upgrading to 6.6 from 4.5.0 . I have commits disabled while indexing total of 85G data during 7 hours. At the end of it, I want some 30 or so big segments. But i am getting 3000 segments. I deleted the index and enabled infostream logging