Re: write.lock file
petite_abeille wrote: On Tuesday, Dec 17, 2002, at 17:43 Europe/Zurich, Doug Cutting wrote: Index updates are atomic, so it is very unlikely that the index is corrupted, unless the underlying file system itself is corrupted. Ummm... Perhaps in theory... In practice, indexes seems to get corrupted quiet easily in my experience. On the other hand, I seldom get a file system corruption. As always, YMMV. Can you provide a reproducible test case that demonstrates index corruption? Doug -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED]
Re: write.lock file
On Friday, Dec 20, 2002, at 19:48 Europe/Zurich, Doug Cutting wrote: Can you provide a reproducible test case that demonstrates index corruption? I honestly wish I could. Unfortunately, because of the nature of the application (Otis is familiar with it), I never seem to be able to come up with a consistent test case. I might be using Lucene in a very peculiar way (?) which includes a lot of concurrent read/write/delete on multiple indexes/threads. So I haven't managed to can the problem in a nice and tidy batch oriented test case. Sight... In any case, the external symptoms are: bad file descriptor, read past EOF and array out of bound. Next time around, I will capture the full stack trace and forward it to the list if you guys are interested. Cheers, PA. -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED]
write.lock file
Hello all, This is the first time I have encountered this in 3 months of testing, the above file got created, not sure how or when, but every time I try to write to the index I get an IOException about the indexing being locked. It is obviously due to that file but what would cause that lock to get created and not removed? Let me know. Thanks, Rob -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED]
RE: write.lock file
... an index opened for writing, but not closed successfully (process died, threw a runtime exception, etc.) you might want to check the log(s) for your indexing process and see what failed. in order to write, just delete the lockfile... (sorry not so verbose - busy, busy :) -doug -Original Message- From: Rob Outar [mailto:[EMAIL PROTECTED]] Sent: Tuesday, December 17, 2002 7:22 AM To: Lucene Users List Subject: write.lock file Hello all, This is the first time I have encountered this in 3 months of testing, the above file got created, not sure how or when, but every time I try to write to the index I get an IOException about the indexing being locked. It is obviously due to that file but what would cause that lock to get created and not removed? Let me know. Thanks, Rob -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED]
Re: write.lock file
Sale, Doug wrote: it depends on what you mean by corrupt. i think there are 3 cases: 1) the process died during a non-writing action (woo-hoo!) 2) the process died during a user-writing action (building a document) 3) the process died during a system-writing action (writing an index file) i don't know of any way to verify an index. anyone? in cases 1 or 2, the index should be structurally correct - you might be missing some docs in case2... in case 3 you might have a problem. if you could determine which entries were being written during the process that died, you could delete those entries and re-index them. however, it is possible that some of the global files, like the dictionary might be hosed. i think this is a case of you'll know if it's broken - receive exceptions during routine reads or writes. Index updates are atomic, so it is very unlikely that the index is corrupted, unless the underlying file system itself is corrupted. Doug -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED]
Re: write.lock file
On Tuesday, Dec 17, 2002, at 17:43 Europe/Zurich, Doug Cutting wrote: Index updates are atomic, so it is very unlikely that the index is corrupted, unless the underlying file system itself is corrupted. Ummm... Perhaps in theory... In practice, indexes seems to get corrupted quiet easily in my experience. On the other hand, I seldom get a file system corruption. As always, YMMV. PA. -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED]
RE: Removing a write.lock file
Then how am I supposed to deal with the write.lock file ? -Original Message- From: Armbrust, Daniel C. [mailto:[EMAIL PROTECTED]] Sent: Thursday, April 18, 2002 9:05 PM To: 'Lucene Users List' Subject: RE: Removing a write.lock file If your not letting lucene remove the write.lock file, and doing it with your own code, that just screams out to me to be a very bad thing to do. Unless of course you want things to get corrupted. Maybe it has worked for you so far, out of luck, but I'm sure its not the way you are supposed to be doing things. -Original Message- From: Biswas, Goutam_Kumar [mailto:[EMAIL PROTECTED]] Sent: Thursday, April 18, 2002 10:25 AM To: 'Lucene Users List' Subject: RE: Removing a write.lock file I'm not removing the write.lock file by hand. I'm doing it inside the code before opening the index -Goutam -Original Message- From: Aruna Raghavan [mailto:[EMAIL PROTECTED]] Sent: Thursday, April 18, 2002 8:37 PM To: 'Lucene Users List' Subject: RE: Removing a write.lock file I don't think it is a good approach to delete the write.lock file by hand. It is there for a reason. You may want to dig into some of the older dialogs/e-mails on this topic. -Original Message- From: Biswas, Goutam_Kumar [mailto:[EMAIL PROTECTED]] Sent: Thursday, April 18, 2002 9:53 AM To: 'Lucene Users List' Subject: RE: Removing a write.lock file well suneetha, before I write to the index I check whether a write.lock file exists! If it does I delete it before opening the index. It works fine for me. -Goutam -Original Message- From: Aruna Raghavan [mailto:[EMAIL PROTECTED]] Sent: Thursday, April 18, 2002 8:22 PM To: 'Lucene Users List' Subject: RE: Removing a write.lock file Hi, The write.lock file won't be there if you close the index using a lock mechanism. I use my own RWLock to access the index dir and unlock it after I close the index. Basically, the access to the index is synchronized. I have never had any problems with this approach. Aruna. -Original Message- From: suneethad [mailto:[EMAIL PROTECTED]] Sent: Wednesday, April 17, 2002 11:47 PM To: Lucene Users List Subject: Removing a write.lock file Hi, I'm currently indexing allowing multiple access , I find that a write.lock file has got created. I know this is to prevent multiple writers, but now how do I continue.??I do not want to reindex as I work on a very large database and it takes a real long time How do I remove this lock file ?? Thanx 4 ur help, Suneetha. -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED]
RE: Removing a write.lock file
Since I am far from a lucene expert, I would suggest searching the archive for write.lock, I'm sure this has been discussed before. My belief is that when you call the close method to close your index writer, it removes the write.lock file. Someone please verify/correct me if I'm wrong. -Original Message- From: Biswas, Goutam_Kumar [mailto:[EMAIL PROTECTED]] Sent: Friday, April 19, 2002 1:25 AM To: 'Lucene Users List' Subject: RE: Removing a write.lock file Then how am I supposed to deal with the write.lock file ? -Original Message- From: Armbrust, Daniel C. [mailto:[EMAIL PROTECTED]] Sent: Thursday, April 18, 2002 9:05 PM To: 'Lucene Users List' Subject: RE: Removing a write.lock file If your not letting lucene remove the write.lock file, and doing it with your own code, that just screams out to me to be a very bad thing to do. Unless of course you want things to get corrupted. Maybe it has worked for you so far, out of luck, but I'm sure its not the way you are supposed to be doing things. -Original Message- From: Biswas, Goutam_Kumar [mailto:[EMAIL PROTECTED]] Sent: Thursday, April 18, 2002 10:25 AM To: 'Lucene Users List' Subject: RE: Removing a write.lock file I'm not removing the write.lock file by hand. I'm doing it inside the code before opening the index -Goutam -Original Message- From: Aruna Raghavan [mailto:[EMAIL PROTECTED]] Sent: Thursday, April 18, 2002 8:37 PM To: 'Lucene Users List' Subject: RE: Removing a write.lock file I don't think it is a good approach to delete the write.lock file by hand. It is there for a reason. You may want to dig into some of the older dialogs/e-mails on this topic. -Original Message- From: Biswas, Goutam_Kumar [mailto:[EMAIL PROTECTED]] Sent: Thursday, April 18, 2002 9:53 AM To: 'Lucene Users List' Subject: RE: Removing a write.lock file well suneetha, before I write to the index I check whether a write.lock file exists! If it does I delete it before opening the index. It works fine for me. -Goutam -Original Message- From: Aruna Raghavan [mailto:[EMAIL PROTECTED]] Sent: Thursday, April 18, 2002 8:22 PM To: 'Lucene Users List' Subject: RE: Removing a write.lock file Hi, The write.lock file won't be there if you close the index using a lock mechanism. I use my own RWLock to access the index dir and unlock it after I close the index. Basically, the access to the index is synchronized. I have never had any problems with this approach. Aruna. -Original Message- From: suneethad [mailto:[EMAIL PROTECTED]] Sent: Wednesday, April 17, 2002 11:47 PM To: Lucene Users List Subject: Removing a write.lock file Hi, I'm currently indexing allowing multiple access , I find that a write.lock file has got created. I know this is to prevent multiple writers, but now how do I continue.??I do not want to reindex as I work on a very large database and it takes a real long time How do I remove this lock file ?? Thanx 4 ur help, Suneetha. -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED]
RE: Removing a write.lock file
Hi, The write.lock file won't be there if you close the index using a lock mechanism. I use my own RWLock to access the index dir and unlock it after I close the index. Basically, the access to the index is synchronized. I have never had any problems with this approach. Aruna. -Original Message- From: suneethad [mailto:[EMAIL PROTECTED]] Sent: Wednesday, April 17, 2002 11:47 PM To: Lucene Users List Subject: Removing a write.lock file Hi, I'm currently indexing allowing multiple access , I find that a write.lock file has got created. I know this is to prevent multiple writers, but now how do I continue.??I do not want to reindex as I work on a very large database and it takes a real long time How do I remove this lock file ?? Thanx 4 ur help, Suneetha. -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED]
RE: Removing a write.lock file
well suneetha, before I write to the index I check whether a write.lock file exists! If it does I delete it before opening the index. It works fine for me. -Goutam -Original Message- From: Aruna Raghavan [mailto:[EMAIL PROTECTED]] Sent: Thursday, April 18, 2002 8:22 PM To: 'Lucene Users List' Subject: RE: Removing a write.lock file Hi, The write.lock file won't be there if you close the index using a lock mechanism. I use my own RWLock to access the index dir and unlock it after I close the index. Basically, the access to the index is synchronized. I have never had any problems with this approach. Aruna. -Original Message- From: suneethad [mailto:[EMAIL PROTECTED]] Sent: Wednesday, April 17, 2002 11:47 PM To: Lucene Users List Subject: Removing a write.lock file Hi, I'm currently indexing allowing multiple access , I find that a write.lock file has got created. I know this is to prevent multiple writers, but now how do I continue.??I do not want to reindex as I work on a very large database and it takes a real long time How do I remove this lock file ?? Thanx 4 ur help, Suneetha. -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED]
RE: Removing a write.lock file
I don't think it is a good approach to delete the write.lock file by hand. It is there for a reason. You may want to dig into some of the older dialogs/e-mails on this topic. -Original Message- From: Biswas, Goutam_Kumar [mailto:[EMAIL PROTECTED]] Sent: Thursday, April 18, 2002 9:53 AM To: 'Lucene Users List' Subject: RE: Removing a write.lock file well suneetha, before I write to the index I check whether a write.lock file exists! If it does I delete it before opening the index. It works fine for me. -Goutam -Original Message- From: Aruna Raghavan [mailto:[EMAIL PROTECTED]] Sent: Thursday, April 18, 2002 8:22 PM To: 'Lucene Users List' Subject: RE: Removing a write.lock file Hi, The write.lock file won't be there if you close the index using a lock mechanism. I use my own RWLock to access the index dir and unlock it after I close the index. Basically, the access to the index is synchronized. I have never had any problems with this approach. Aruna. -Original Message- From: suneethad [mailto:[EMAIL PROTECTED]] Sent: Wednesday, April 17, 2002 11:47 PM To: Lucene Users List Subject: Removing a write.lock file Hi, I'm currently indexing allowing multiple access , I find that a write.lock file has got created. I know this is to prevent multiple writers, but now how do I continue.??I do not want to reindex as I work on a very large database and it takes a real long time How do I remove this lock file ?? Thanx 4 ur help, Suneetha. -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED]
RE: Removing a write.lock file
I'm not removing the write.lock file by hand. I'm doing it inside the code before opening the index -Goutam -Original Message- From: Aruna Raghavan [mailto:[EMAIL PROTECTED]] Sent: Thursday, April 18, 2002 8:37 PM To: 'Lucene Users List' Subject: RE: Removing a write.lock file I don't think it is a good approach to delete the write.lock file by hand. It is there for a reason. You may want to dig into some of the older dialogs/e-mails on this topic. -Original Message- From: Biswas, Goutam_Kumar [mailto:[EMAIL PROTECTED]] Sent: Thursday, April 18, 2002 9:53 AM To: 'Lucene Users List' Subject: RE: Removing a write.lock file well suneetha, before I write to the index I check whether a write.lock file exists! If it does I delete it before opening the index. It works fine for me. -Goutam -Original Message- From: Aruna Raghavan [mailto:[EMAIL PROTECTED]] Sent: Thursday, April 18, 2002 8:22 PM To: 'Lucene Users List' Subject: RE: Removing a write.lock file Hi, The write.lock file won't be there if you close the index using a lock mechanism. I use my own RWLock to access the index dir and unlock it after I close the index. Basically, the access to the index is synchronized. I have never had any problems with this approach. Aruna. -Original Message- From: suneethad [mailto:[EMAIL PROTECTED]] Sent: Wednesday, April 17, 2002 11:47 PM To: Lucene Users List Subject: Removing a write.lock file Hi, I'm currently indexing allowing multiple access , I find that a write.lock file has got created. I know this is to prevent multiple writers, but now how do I continue.??I do not want to reindex as I work on a very large database and it takes a real long time How do I remove this lock file ?? Thanx 4 ur help, Suneetha. -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED]
RE: Removing a write.lock file
Sorry, but I would say the same thing. I don't think you are supposed do it even programmatically. It is a lock internal to lucene. -Original Message- From: Biswas, Goutam_Kumar [mailto:[EMAIL PROTECTED]] Sent: Thursday, April 18, 2002 10:25 AM To: 'Lucene Users List' Subject: RE: Removing a write.lock file I'm not removing the write.lock file by hand. I'm doing it inside the code before opening the index -Goutam -Original Message- From: Aruna Raghavan [mailto:[EMAIL PROTECTED]] Sent: Thursday, April 18, 2002 8:37 PM To: 'Lucene Users List' Subject: RE: Removing a write.lock file I don't think it is a good approach to delete the write.lock file by hand. It is there for a reason. You may want to dig into some of the older dialogs/e-mails on this topic. -Original Message- From: Biswas, Goutam_Kumar [mailto:[EMAIL PROTECTED]] Sent: Thursday, April 18, 2002 9:53 AM To: 'Lucene Users List' Subject: RE: Removing a write.lock file well suneetha, before I write to the index I check whether a write.lock file exists! If it does I delete it before opening the index. It works fine for me. -Goutam -Original Message- From: Aruna Raghavan [mailto:[EMAIL PROTECTED]] Sent: Thursday, April 18, 2002 8:22 PM To: 'Lucene Users List' Subject: RE: Removing a write.lock file Hi, The write.lock file won't be there if you close the index using a lock mechanism. I use my own RWLock to access the index dir and unlock it after I close the index. Basically, the access to the index is synchronized. I have never had any problems with this approach. Aruna. -Original Message- From: suneethad [mailto:[EMAIL PROTECTED]] Sent: Wednesday, April 17, 2002 11:47 PM To: Lucene Users List Subject: Removing a write.lock file Hi, I'm currently indexing allowing multiple access , I find that a write.lock file has got created. I know this is to prevent multiple writers, but now how do I continue.??I do not want to reindex as I work on a very large database and it takes a real long time How do I remove this lock file ?? Thanx 4 ur help, Suneetha. -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED]
Removing a write.lock file
Hi, I'm currently indexing allowing multiple access , I find that a write.lock file has got created. I know this is to prevent multiple writers, but now how do I continue.??I do not want to reindex as I work on a very large database and it takes a real long time How do I remove this lock file ?? Thanx 4 ur help, Suneetha. -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED]
RE: write.lock file
I cannot replicate the problem you are having. Can you please submit a complete, self-contained, test case illustrating the problem you are having with the write lock. Please test this against the latest nightly build of Lucene, from: http://jakarta.apache.org/builds/jakarta-lucene/nightly/ Thanks, Doug -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED]
Re: write.lock file
Hi, As I understand it, it is made to allow multiple access to an index but only one writer at a time. It is created by IndexWriter on constructor and destroyed when the indexWriter is closed. regards, Jerome - Original Message - From: suneethad [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Tuesday, February 12, 2002 2:42 PM Subject: write.lock file Hi, Whenever I index some files I'm getting some lock files created (write.lock).Can somebody tell me what do these mean and how can I remove them . Regards, Suneetha -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED] -- To unsubscribe, e-mail: mailto:[EMAIL PROTECTED] For additional commands, e-mail: mailto:[EMAIL PROTECTED]
