This is normal. When you open an IndexReader/IndexSearcher, it opens various file handles. If you additionally update/add/delete documents in parallel (even in other process), or optimize the index, the original IndexReader stays on using the "old" state of the index. IndexWriter deletes some files, but IndexReader still have them open (this is our segment based "transaction" handling of IndexWriter). If you reopen your IndexReader to get the last updates of the underlying index, these "deleted" files will disappear, as they can be closed. As long as they are open, they disappear from directory listing, but they still consume space on disk (because they are still used). This is why you see this deleted files.
----- Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de > From: Ganesh [mailto:emailg...@yahoo.co.in] > Sent: Friday, September 04, 2009 8:11 AM > To: java-user@lucene.apache.org > Subject: too many file descriptors opened by Lucene shows (deleted) in > /proc > > Hello all, > > In my linux pc, there are too many fd counts for lucene database. > /proc/<processid>/fd shows very big list. I have provided sample below. > > lr-x------ 1 root root 64 Sep 3 17:02 360 -> > /opt/ganesh/lucenedb/_2w5.tvf (deleted) > lr-x------ 1 root root 64 Sep 3 17:02 361 -> > /opt/ganesh/lucenedb/_hr.frq (deleted) > lr-x------ 1 root root 64 Sep 3 17:02 362 -> > /opt/ganesh/lucenedb/_hr.prx (deleted) > lr-x------ 1 root root 64 Sep 3 17:02 363 -> > /opt/ganesh/lucenedb/_hr.tvx (deleted) > lr-x------ 1 root root 64 Sep 3 21:01 364 -> > /opt/ganesh/lucenedb/_hr.tvd (deleted) > lr-x------ 1 root root 64 Sep 3 17:02 365 -> > /opt/ganesh/lucenedb/_hr.tvf (deleted) > lr-x------ 1 root root 64 Sep 3 17:02 366 -> > /opt/ganesh/lucenedb/_2w4.fdt (deleted) > lr-x------ 1 root root 64 Sep 3 17:02 367 -> > /opt/ganesh/lucenedb/_2w4.fdx (deleted) > > These files not exist in the disk but why it is showing as (deleted) in > the /proc. This means the process is still holding the fd. Please provide > me more information on this. I am using Fedora Linux, ext-3 file system, > Lucene 2.4.1. > > Regards > Ganesh > Send instant messages to your online friends http://in.messenger.yahoo.com > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > For additional commands, e-mail: java-user-h...@lucene.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
