slow search threads during a disk copy

2010-08-23 Thread gaganb
Hi all, We're observing search threads slowing down during directory copies performed during updates to the index. The thread dump shows search threads blocked on a FSDirectory$FSIndexInput$Descriptor instance: "Worker Thread - 12" daemon prio=10 tid=0x082b2400 nid=0x4654 waiting for monit

Re: slow search threads during a disk copy

2010-08-23 Thread gaganb
We suspected the same at first, and so modified the flow to do the copy of the new version "before" searching is activated on it. So, there are no searches on the new version dir at the time of copy - yet we still see slowness during the disk copy. Thanks, - Gagan -Original Message--

Re: slow search threads during a disk copy

2010-08-23 Thread gaganb
Yes, all version directories are on the same disk. iostat output should be useful. Using rsync is complicated because of legacy reasons - there's a change impact to manage. Intererstingly, the copy is quite fast (around 30s) when there are no searches in progress. Thanks, - Gagan -Ori