[jira] [Commented] (LUCENE-4467) SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index
[ https://issues.apache.org/jira/browse/LUCENE-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13558849#comment-13558849 ] B.Nicolotti commented on LUCENE-4467: - We've had the error again: Sat Jan 19 22:30:14 CET 2013:com.siap.WebServices.Utility.UtiIndexerLucene caught an exception: 16023383 java.io.FileNotFoundException e.toString():java.io.FileNotFoundException: /usr/local/WS_DynPkg/logs/index/_c8_7.del (No such file or directory), e.getMessage():/usr/local/WS_DynPkg/logs/index/_c8_7.del (No such file or directory) java.io.RandomAccessFile.open(Native Method) java.io.RandomAccessFile.init(RandomAccessFile.java:212) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.init(SimpleFSDirectory.java:71) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(SimpleFSDirectory.java:98) at that time (22:30) we've a scheduled thread to delete unused stuff from index, but there was 2 webapps within the same o.s. process running the java VM running the cancel procedure on the same index, they removed the same documents the same time, this may be the problem. I've set only one thread. Sat Jan 19 22:30:11 CET 2013 Deleting unlinked log (/usr/local/tomcat/webapps/WS_DynPkg_1_9_0/) older than 36 hours that is between:1301183011 and 130118103011 pre Start deleting: Sat Jan 19 22:30:13 CET 2013 deleted: 20130118053133406-138 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118053133406-138.log deleted: 20130118052757017-124 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052757017-124.log deleted: 20130118053000255-132 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118053000255-132.log deleted: 20130118052929471-130 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052929471-130.log deleted: 20130118052843289-127 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052843289-127.log deleted: 20130118053204207-140 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118053204207-140.log deleted: 20130118052123562-108 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052123562-108.log deleted: 20130118053235098-142 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118053235098-142.log deleted: 20130118053046466-135 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118053046466-135.log deleted: 20130118052224901-112 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052224901-112.log deleted: 20130118052240261-113 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052240261-113.log deleted: 20130118052827875-126 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052827875-126.log deleted: 20130118052914086-129 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052914086-129.log deleted: 20130118052412967-119 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052412967-119.log deleted: 20130118052459037-122 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052459037-122.log deleted: 20130118052209536-111 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052209536-111.log deleted: 20130118052007858-105 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052007858-105.log deleted: 20130118052108221-107 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052108221-107.log deleted: 20130118052812471-125 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052812471-125.log deleted: 20130118052357084-118 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052357084-118.log deleted: 20130118052514372-123 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052514372-123.log deleted: 20130118053117277-137 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118053117277-137.log deleted: 20130118053101905-136 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118053101905-136.log deleted: 20130118052052530-106 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052052530-106.log deleted: 20130118053148805-139 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118053148805-139.log deleted: 20130118052858677-128 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052858677-128.log deleted: 20130118053031057-134 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118053031057-134.log deleted: 20130118052341640-117 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052341640-117.log deleted: 20130118052310932-115 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052310932-115.log deleted: 20130118052428308-120 from index deleted: /usr/local/WS_DynPkg/logs/log_2013-01-18.20130118052428308-120.log deleted:
[jira] [Commented] (LUCENE-4467) SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index
[ https://issues.apache.org/jira/browse/LUCENE-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13545845#comment-13545845 ] B.Nicolotti commented on LUCENE-4467: - Hello, we put in test only one web app writing the index, but we had again a problem: Sat Jan 05 22:30:28 CET 2013:com.siap.WebServices.Utility.UtiIndexerLucene caught an exception: 29361740 org.apache.lucene.index.CorruptIndexException e.toString():org.apache.lucene.index.CorruptIndexException: failed to locate current segments_N file, e.getMessage():failed to locate current segments_N file org.apache.lucene.index.IndexFileDeleter.init(IndexFileDeleter.java:233) org.apache.lucene.index.IndexWriter.init(IndexWriter.java:1168) com.siap.WebServices.Utility.UtiIndexerLucene.delete(UtiIndexerLucene.java:141) com.siap.WebServices.Utility.SerLogSearch.deleteIdList(SerLogSearch.java:728) com.siap.WebServices.Utility.SerLogSearch.cleanUnlinked(SerLogSearch.java:650) com.siap.WebServices.Utility.SerLogSearch.access$0(SerLogSearch.java:582) com.siap.WebServices.Utility.SerLogSearch$LogOpTimer.run(SerLogSearch.java:155) from this time on the index didn't work any more: Sat Jan 05 22:30:28 CET 2013:com.siap.WebServices.Utility.UtiIndexerLucene caught an exception: 3133093 java.io.FileNotFoundException e.toString():java.io.FileNotFoundException: /usr/local/WS_DynPkg/logs/index/_2da_10.del (No such file or directory), e.getMessage():/usr/local/WS_DynPkg/logs/index/_2da_10.del (No such file or directory) java.io.RandomAccessFile.open(Native Method) java.io.RandomAccessFile.init(RandomAccessFile.java:212) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.init(SimpleFSDirectory.java:71) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(SimpleFSDirectory.java:98) org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFSDirectory.java:92) org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:79) org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345) org.apache.lucene.util.BitVector.init(BitVector.java:266) org.apache.lucene.index.SegmentReader.loadDeletedDocs(SegmentReader.java:160) org.apache.lucene.index.SegmentReader.get(SegmentReader.java:120) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:696) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:671) org.apache.lucene.index.BufferedDeletesStream.applyDeletes(BufferedDeletesStream.java:244) org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3608) org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3545) org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1852) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1812) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1776) com.siap.WebServices.Utility.UtiIndexerLucene.delete(UtiIndexerLucene.java:145) com.siap.WebServices.Utility.SerLogSearch.deleteIdList(SerLogSearch.java:728) com.siap.WebServices.Utility.SerLogSearch.cleanUnlinked(SerLogSearch.java:650) com.siap.WebServices.Utility.SerLogSearch.access$0(SerLogSearch.java:582) com.siap.WebServices.Utility.SerLogSearch$LogOpTimer.run(SerLogSearch.java:155) how do I run CheckIndex -fix ? Many thanks Best regards Bartolomeo SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index Key: LUCENE-4467 URL: https://issues.apache.org/jira/browse/LUCENE-4467 Project: Lucene - Core Issue Type: Bug Affects Versions: 3.6 Environment: Currently using: java -version java version 1.5.0_13 Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_13-b05) Java HotSpot(TM) Client VM (build 1.5.0_13-b05, mixed mode, sharing) Tomcat 5.5 lucene 3.6.0 Reporter: B.Nicolotti Attachments: index.zip We're using lucene to index XML. We've had it in test on a server for some weeks with no problem, but today we've got the error below and the index seems no longer usable. Could you please tell us 1) is there a way to recover the index? 2) is there a way to avoid this error? I can supply the index if needed many thanks Tue Oct 09 17:41:02 CEST 2012:com.siap.WebServices.Utility.UtiIndexerLucene caught an exception: 32225010 java.io.FileNotFoundException e.toString():java.io.FileNotFoundException: /usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory), e.getMessage():/usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory) java.io.RandomAccessFile.open(Native Method) java.io.RandomAccessFile.init(RandomAccessFile.java:212) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.init(SimpleFSDirectory.java:71)
[jira] [Commented] (LUCENE-4467) SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index
[
https://issues.apache.org/jira/browse/LUCENE-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13545890#comment-13545890
]
B.Nicolotti commented on LUCENE-4467:
-
I've been able to run checkindex on corrupted index:
bartolomeo@LxPC37:~/Condivisa/TestFutur/2013/01/07$ luceneCheckIndex.sh ./index
NOTE: testing will be more thorough if you run java with
'-ea:org.apache.lucene...', so assertions are enabled
Opening index @ ./index
Segments file=segments_3g3 numSegments=2 version=3.6 format=FORMAT_3_1 [Lucene
3.1+]
1 of 2: name=_2da docCount=1097
compound=false
hasProx=true
numFiles=9
FAILED
WARNING: fixIndex() would remove reference to this segment; full exception:
java.io.FileNotFoundException: _2da_10.del
at org.apache.lucene.store.FSDirectory.fileLength(FSDirectory.java:284)
at org.apache.lucene.index.SegmentInfo.sizeInBytes(SegmentInfo.java:303)
at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:494)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:1064)
2 of 2: name=_2db docCount=1
compound=true
hasProx=true
numFiles=1
size (MB)=0,001
diagnostics = {os.version=2.6.15-51-386, os=Linux, source=flush,
lucene.version=3.6.0 1310449 - rmuir - 2012-04-06 11:29:22, os.arch=i386,
java.version=1.5.0_22, java.vendor=Sun Microsystems Inc.}
no deletions
test: open reader.OK
test: fields..OK [6 fields]
test: field norms.OK [6 fields]
test: terms, freq, prox...OK [30 terms; 30 terms/docs pairs; 30 tokens]
test: stored fields...OK [5 total field count; avg 5 fields per doc]
test: term vectorsOK [0 total vector count; avg 0 term/freq vector
fields per doc]
WARNING: 1 broken segments (containing 1097 documents) detected
WARNING: would write new segments file, and 1097 documents would be lost, if
-fix were specified
Our applications indexes many xml files. 90% of these are cancelled each day,
as only the reamining 10% are to be maintaned for more than one day. The error
in previous comment occurred during the daily cancellation task. May this be
the problem?
Many thanks
best regards
Bartolomeo
SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del -
corrupted index
Key: LUCENE-4467
URL: https://issues.apache.org/jira/browse/LUCENE-4467
Project: Lucene - Core
Issue Type: Bug
Affects Versions: 3.6
Environment: Currently using:
java -version
java version 1.5.0_13
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_13-b05)
Java HotSpot(TM) Client VM (build 1.5.0_13-b05, mixed mode, sharing)
Tomcat 5.5
lucene 3.6.0
Reporter: B.Nicolotti
Attachments: index.zip
We're using lucene to index XML. We've had it in test on a server for some
weeks with no problem, but today we've got the error below and the index
seems no longer usable.
Could you please tell us
1) is there a way to recover the index?
2) is there a way to avoid this error?
I can supply the index if needed
many thanks
Tue Oct 09 17:41:02 CEST 2012:com.siap.WebServices.Utility.UtiIndexerLucene
caught an exception: 32225010 java.io.FileNotFoundException
e.toString():java.io.FileNotFoundException:
/usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory),
e.getMessage():/usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or
directory)
java.io.RandomAccessFile.open(Native Method)
java.io.RandomAccessFile.init(RandomAccessFile.java:212)
org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.init(SimpleFSDirectory.java:71)
org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(SimpleFSDirectory.java:98)
org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFSDirectory.java:92)
org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:79)
org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345)
org.apache.lucene.util.BitVector.init(BitVector.java:266)
org.apache.lucene.index.SegmentReader.loadDeletedDocs(SegmentReader.java:160)
org.apache.lucene.index.SegmentReader.get(SegmentReader.java:120)
org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:696)
org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:671)
org.apache.lucene.index.BufferedDeletesStream.applyDeletes(BufferedDeletesStream.java:244)
org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3608)
org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3545)
org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1852)
org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1812)
org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1776)
[jira] [Commented] (LUCENE-4467) SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index
[ https://issues.apache.org/jira/browse/LUCENE-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13545897#comment-13545897 ] Michael McCandless commented on LUCENE-4467: Can you post the IndexWriter infoStream output leading up to the corruption? SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index Key: LUCENE-4467 URL: https://issues.apache.org/jira/browse/LUCENE-4467 Project: Lucene - Core Issue Type: Bug Affects Versions: 3.6 Environment: Currently using: java -version java version 1.5.0_13 Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_13-b05) Java HotSpot(TM) Client VM (build 1.5.0_13-b05, mixed mode, sharing) Tomcat 5.5 lucene 3.6.0 Reporter: B.Nicolotti Attachments: index.zip We're using lucene to index XML. We've had it in test on a server for some weeks with no problem, but today we've got the error below and the index seems no longer usable. Could you please tell us 1) is there a way to recover the index? 2) is there a way to avoid this error? I can supply the index if needed many thanks Tue Oct 09 17:41:02 CEST 2012:com.siap.WebServices.Utility.UtiIndexerLucene caught an exception: 32225010 java.io.FileNotFoundException e.toString():java.io.FileNotFoundException: /usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory), e.getMessage():/usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory) java.io.RandomAccessFile.open(Native Method) java.io.RandomAccessFile.init(RandomAccessFile.java:212) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.init(SimpleFSDirectory.java:71) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(SimpleFSDirectory.java:98) org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFSDirectory.java:92) org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:79) org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345) org.apache.lucene.util.BitVector.init(BitVector.java:266) org.apache.lucene.index.SegmentReader.loadDeletedDocs(SegmentReader.java:160) org.apache.lucene.index.SegmentReader.get(SegmentReader.java:120) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:696) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:671) org.apache.lucene.index.BufferedDeletesStream.applyDeletes(BufferedDeletesStream.java:244) org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3608) org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3545) org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1852) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1812) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1776) com.siap.WebServices.Utility.UtiIndexerLucene.delete(UtiIndexerLucene.java:143) com.siap.WebServices.Utility.UtiIndexerLucene.indexFile(UtiIndexerLucene.java:221) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-4467) SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index
[ https://issues.apache.org/jira/browse/LUCENE-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13545909#comment-13545909 ] B.Nicolotti commented on LUCENE-4467: - I think to have this we should initialize the infoStream, shouldn't we? Sadly we don't do this, I'll switch this infoStream on so that if it'll happen again we'll have this information. I googled about IndexWriter infostream, but I found only this: http://lucene.472066.n3.nabble.com/Understanding-the-IndexWriter-Infostream-log-td2694439.html Could you please help us activating IndexWriter infoStream? many thank Best regards Bartolomeo SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index Key: LUCENE-4467 URL: https://issues.apache.org/jira/browse/LUCENE-4467 Project: Lucene - Core Issue Type: Bug Affects Versions: 3.6 Environment: Currently using: java -version java version 1.5.0_13 Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_13-b05) Java HotSpot(TM) Client VM (build 1.5.0_13-b05, mixed mode, sharing) Tomcat 5.5 lucene 3.6.0 Reporter: B.Nicolotti Attachments: index.zip We're using lucene to index XML. We've had it in test on a server for some weeks with no problem, but today we've got the error below and the index seems no longer usable. Could you please tell us 1) is there a way to recover the index? 2) is there a way to avoid this error? I can supply the index if needed many thanks Tue Oct 09 17:41:02 CEST 2012:com.siap.WebServices.Utility.UtiIndexerLucene caught an exception: 32225010 java.io.FileNotFoundException e.toString():java.io.FileNotFoundException: /usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory), e.getMessage():/usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory) java.io.RandomAccessFile.open(Native Method) java.io.RandomAccessFile.init(RandomAccessFile.java:212) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.init(SimpleFSDirectory.java:71) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(SimpleFSDirectory.java:98) org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFSDirectory.java:92) org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:79) org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345) org.apache.lucene.util.BitVector.init(BitVector.java:266) org.apache.lucene.index.SegmentReader.loadDeletedDocs(SegmentReader.java:160) org.apache.lucene.index.SegmentReader.get(SegmentReader.java:120) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:696) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:671) org.apache.lucene.index.BufferedDeletesStream.applyDeletes(BufferedDeletesStream.java:244) org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3608) org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3545) org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1852) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1812) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1776) com.siap.WebServices.Utility.UtiIndexerLucene.delete(UtiIndexerLucene.java:143) com.siap.WebServices.Utility.UtiIndexerLucene.indexFile(UtiIndexerLucene.java:221) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-4467) SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index
[ https://issues.apache.org/jira/browse/LUCENE-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13545917#comment-13545917 ] B.Nicolotti commented on LUCENE-4467: - I've addede this line: idxWr.setInfoStream(new PrintStream(new File(/tmp/IndexWriter.infoStream.log))); is this enough to write information to the log file? Many thanks Best regards Bartolomeo SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index Key: LUCENE-4467 URL: https://issues.apache.org/jira/browse/LUCENE-4467 Project: Lucene - Core Issue Type: Bug Affects Versions: 3.6 Environment: Currently using: java -version java version 1.5.0_13 Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_13-b05) Java HotSpot(TM) Client VM (build 1.5.0_13-b05, mixed mode, sharing) Tomcat 5.5 lucene 3.6.0 Reporter: B.Nicolotti Attachments: index.zip We're using lucene to index XML. We've had it in test on a server for some weeks with no problem, but today we've got the error below and the index seems no longer usable. Could you please tell us 1) is there a way to recover the index? 2) is there a way to avoid this error? I can supply the index if needed many thanks Tue Oct 09 17:41:02 CEST 2012:com.siap.WebServices.Utility.UtiIndexerLucene caught an exception: 32225010 java.io.FileNotFoundException e.toString():java.io.FileNotFoundException: /usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory), e.getMessage():/usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory) java.io.RandomAccessFile.open(Native Method) java.io.RandomAccessFile.init(RandomAccessFile.java:212) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.init(SimpleFSDirectory.java:71) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(SimpleFSDirectory.java:98) org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFSDirectory.java:92) org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:79) org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345) org.apache.lucene.util.BitVector.init(BitVector.java:266) org.apache.lucene.index.SegmentReader.loadDeletedDocs(SegmentReader.java:160) org.apache.lucene.index.SegmentReader.get(SegmentReader.java:120) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:696) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:671) org.apache.lucene.index.BufferedDeletesStream.applyDeletes(BufferedDeletesStream.java:244) org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3608) org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3545) org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1852) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1812) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1776) com.siap.WebServices.Utility.UtiIndexerLucene.delete(UtiIndexerLucene.java:143) com.siap.WebServices.Utility.UtiIndexerLucene.indexFile(UtiIndexerLucene.java:221) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-4467) SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index
[ https://issues.apache.org/jira/browse/LUCENE-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13545960#comment-13545960 ] Michael McCandless commented on LUCENE-4467: I think that should do the trick, thanks. The only problem is you have to ensure only one IndexWriter writes to that log file at a time. SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index Key: LUCENE-4467 URL: https://issues.apache.org/jira/browse/LUCENE-4467 Project: Lucene - Core Issue Type: Bug Affects Versions: 3.6 Environment: Currently using: java -version java version 1.5.0_13 Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_13-b05) Java HotSpot(TM) Client VM (build 1.5.0_13-b05, mixed mode, sharing) Tomcat 5.5 lucene 3.6.0 Reporter: B.Nicolotti Attachments: index.zip We're using lucene to index XML. We've had it in test on a server for some weeks with no problem, but today we've got the error below and the index seems no longer usable. Could you please tell us 1) is there a way to recover the index? 2) is there a way to avoid this error? I can supply the index if needed many thanks Tue Oct 09 17:41:02 CEST 2012:com.siap.WebServices.Utility.UtiIndexerLucene caught an exception: 32225010 java.io.FileNotFoundException e.toString():java.io.FileNotFoundException: /usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory), e.getMessage():/usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory) java.io.RandomAccessFile.open(Native Method) java.io.RandomAccessFile.init(RandomAccessFile.java:212) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.init(SimpleFSDirectory.java:71) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(SimpleFSDirectory.java:98) org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFSDirectory.java:92) org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:79) org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345) org.apache.lucene.util.BitVector.init(BitVector.java:266) org.apache.lucene.index.SegmentReader.loadDeletedDocs(SegmentReader.java:160) org.apache.lucene.index.SegmentReader.get(SegmentReader.java:120) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:696) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:671) org.apache.lucene.index.BufferedDeletesStream.applyDeletes(BufferedDeletesStream.java:244) org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3608) org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3545) org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1852) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1812) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1776) com.siap.WebServices.Utility.UtiIndexerLucene.delete(UtiIndexerLucene.java:143) com.siap.WebServices.Utility.UtiIndexerLucene.indexFile(UtiIndexerLucene.java:221) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-4467) SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index
[ https://issues.apache.org/jira/browse/LUCENE-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13546001#comment-13546001 ] B.Nicolotti commented on LUCENE-4467: - Maybe it would be better to use IndexWriter.setDefaultInfoStream(new PrintStream(new File(/tmp/IndexWriter.infoStream.log))); ? Many thanks Best regards Bartolomeo SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index Key: LUCENE-4467 URL: https://issues.apache.org/jira/browse/LUCENE-4467 Project: Lucene - Core Issue Type: Bug Affects Versions: 3.6 Environment: Currently using: java -version java version 1.5.0_13 Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_13-b05) Java HotSpot(TM) Client VM (build 1.5.0_13-b05, mixed mode, sharing) Tomcat 5.5 lucene 3.6.0 Reporter: B.Nicolotti Attachments: index.zip We're using lucene to index XML. We've had it in test on a server for some weeks with no problem, but today we've got the error below and the index seems no longer usable. Could you please tell us 1) is there a way to recover the index? 2) is there a way to avoid this error? I can supply the index if needed many thanks Tue Oct 09 17:41:02 CEST 2012:com.siap.WebServices.Utility.UtiIndexerLucene caught an exception: 32225010 java.io.FileNotFoundException e.toString():java.io.FileNotFoundException: /usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory), e.getMessage():/usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory) java.io.RandomAccessFile.open(Native Method) java.io.RandomAccessFile.init(RandomAccessFile.java:212) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.init(SimpleFSDirectory.java:71) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(SimpleFSDirectory.java:98) org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFSDirectory.java:92) org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:79) org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345) org.apache.lucene.util.BitVector.init(BitVector.java:266) org.apache.lucene.index.SegmentReader.loadDeletedDocs(SegmentReader.java:160) org.apache.lucene.index.SegmentReader.get(SegmentReader.java:120) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:696) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:671) org.apache.lucene.index.BufferedDeletesStream.applyDeletes(BufferedDeletesStream.java:244) org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3608) org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3545) org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1852) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1812) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1776) com.siap.WebServices.Utility.UtiIndexerLucene.delete(UtiIndexerLucene.java:143) com.siap.WebServices.Utility.UtiIndexerLucene.indexFile(UtiIndexerLucene.java:221) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-4467) SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index
[ https://issues.apache.org/jira/browse/LUCENE-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13546006#comment-13546006 ] Michael McCandless commented on LUCENE-4467: setDefaultInfoStream is a bit better (I'll see stuff logged in IW's ctor) ... SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index Key: LUCENE-4467 URL: https://issues.apache.org/jira/browse/LUCENE-4467 Project: Lucene - Core Issue Type: Bug Affects Versions: 3.6 Environment: Currently using: java -version java version 1.5.0_13 Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_13-b05) Java HotSpot(TM) Client VM (build 1.5.0_13-b05, mixed mode, sharing) Tomcat 5.5 lucene 3.6.0 Reporter: B.Nicolotti Attachments: index.zip We're using lucene to index XML. We've had it in test on a server for some weeks with no problem, but today we've got the error below and the index seems no longer usable. Could you please tell us 1) is there a way to recover the index? 2) is there a way to avoid this error? I can supply the index if needed many thanks Tue Oct 09 17:41:02 CEST 2012:com.siap.WebServices.Utility.UtiIndexerLucene caught an exception: 32225010 java.io.FileNotFoundException e.toString():java.io.FileNotFoundException: /usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory), e.getMessage():/usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory) java.io.RandomAccessFile.open(Native Method) java.io.RandomAccessFile.init(RandomAccessFile.java:212) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.init(SimpleFSDirectory.java:71) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(SimpleFSDirectory.java:98) org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFSDirectory.java:92) org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:79) org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345) org.apache.lucene.util.BitVector.init(BitVector.java:266) org.apache.lucene.index.SegmentReader.loadDeletedDocs(SegmentReader.java:160) org.apache.lucene.index.SegmentReader.get(SegmentReader.java:120) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:696) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:671) org.apache.lucene.index.BufferedDeletesStream.applyDeletes(BufferedDeletesStream.java:244) org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3608) org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3545) org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1852) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1812) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1776) com.siap.WebServices.Utility.UtiIndexerLucene.delete(UtiIndexerLucene.java:143) com.siap.WebServices.Utility.UtiIndexerLucene.indexFile(UtiIndexerLucene.java:221) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-4467) SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index
[ https://issues.apache.org/jira/browse/LUCENE-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13498776#comment-13498776 ] Michael McCandless commented on LUCENE-4467: You can run CheckIndex -fix, to recover the index: it will delete any segments that it detects corruption in. Yes, only one IndexWriter at a time may have the index open, regardless of whether the IndexWriters are in the same or difference processes. The 2nd IndexWriter will wait until lock timeout has elapsed and then give up. The logic is very simplistic, and is really designed to protect the Lucene index from corruption, not to make it easy to coordinate writing from multiple writers. But it looks like you hit corruption with a single writer? Can you turn on IndexWriter's infoStream, and next time the corruption happens, post that log? Is this a local or remote filesystem? Can you try upgrading Java (1.5.0_13 is quite old) ... SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index Key: LUCENE-4467 URL: https://issues.apache.org/jira/browse/LUCENE-4467 Project: Lucene - Core Issue Type: Bug Affects Versions: 3.6 Environment: Currently using: java -version java version 1.5.0_13 Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_13-b05) Java HotSpot(TM) Client VM (build 1.5.0_13-b05, mixed mode, sharing) Tomcat 5.5 lucene 3.6.0 Reporter: B.Nicolotti Attachments: index.zip We're using lucene to index XML. We've had it in test on a server for some weeks with no problem, but today we've got the error below and the index seems no longer usable. Could you please tell us 1) is there a way to recover the index? 2) is there a way to avoid this error? I can supply the index if needed many thanks Tue Oct 09 17:41:02 CEST 2012:com.siap.WebServices.Utility.UtiIndexerLucene caught an exception: 32225010 java.io.FileNotFoundException e.toString():java.io.FileNotFoundException: /usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory), e.getMessage():/usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory) java.io.RandomAccessFile.open(Native Method) java.io.RandomAccessFile.init(RandomAccessFile.java:212) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.init(SimpleFSDirectory.java:71) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(SimpleFSDirectory.java:98) org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFSDirectory.java:92) org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:79) org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345) org.apache.lucene.util.BitVector.init(BitVector.java:266) org.apache.lucene.index.SegmentReader.loadDeletedDocs(SegmentReader.java:160) org.apache.lucene.index.SegmentReader.get(SegmentReader.java:120) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:696) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:671) org.apache.lucene.index.BufferedDeletesStream.applyDeletes(BufferedDeletesStream.java:244) org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3608) org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3545) org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1852) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1812) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1776) com.siap.WebServices.Utility.UtiIndexerLucene.delete(UtiIndexerLucene.java:143) com.siap.WebServices.Utility.UtiIndexerLucene.indexFile(UtiIndexerLucene.java:221) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-4467) SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index
[ https://issues.apache.org/jira/browse/LUCENE-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13497163#comment-13497163 ] B.Nicolotti commented on LUCENE-4467: - We left only one web applicatin writing the index with a LockTimeOut of 120s, but we've got a problem: Fri Oct 26 10:08:02 CEST 2012:com.siap.WebServices.Utility.UtiIndexerLucene caught an exception: 13341879 java.io.FileNotFoundException e.toString():java.io.FileNotFoundException: /usr/local/WS_DynPkg/logs/index/_8c0_2c.del (No such file or directory), e.getMessage():/usr/local/WS_DynPkg/logs/index/_8c0_2c.del (No such file or directory) java.io.RandomAccessFile.open(Native Method) java.io.RandomAccessFile.init(RandomAccessFile.java:212) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.init(SimpleFSDirectory.java:71) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(SimpleFSDirectory.java:98) org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFSDirectory.java:92) Fri Oct 26 10:10:02 CEST 2012:com.siap.WebServices.Utility.UtiIndexerLucene indexing:/usr/local/WS_DynPkg/logs//log_2012-10-26.20121026100648672-1.log caught an exception: 1543979 org.apache.lucene.store.LockObtainFailedException e.toString():org.apache.lucene.store.LockObtainFailedException: Lock obtain timed out: NativeFSLock@/usr/local/WS_DynPkg/logs/index/write.lock, e.getMessage():Lock obtain timed out: NativeFSLock@/usr/local/WS_DynPkg/logs/index/write.lock org.apache.lucene.store.Lock.obtain(Lock.java:84) org.apache.lucene.index.IndexWriter.init(IndexWriter.java:1098) and the index is no longer useable. The index seems very sensitive, but we've implemented the indexing only once after writing to logs, and so if the index is broken we've to erase the index What do you suggest? Is it possibile to set an infinite waiting time to get the write.lock? Many thanks Best regards Bartolomeo SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index Key: LUCENE-4467 URL: https://issues.apache.org/jira/browse/LUCENE-4467 Project: Lucene - Core Issue Type: Bug Affects Versions: 3.6 Environment: Currently using: java -version java version 1.5.0_13 Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_13-b05) Java HotSpot(TM) Client VM (build 1.5.0_13-b05, mixed mode, sharing) Tomcat 5.5 lucene 3.6.0 Reporter: B.Nicolotti Attachments: index.zip We're using lucene to index XML. We've had it in test on a server for some weeks with no problem, but today we've got the error below and the index seems no longer usable. Could you please tell us 1) is there a way to recover the index? 2) is there a way to avoid this error? I can supply the index if needed many thanks Tue Oct 09 17:41:02 CEST 2012:com.siap.WebServices.Utility.UtiIndexerLucene caught an exception: 32225010 java.io.FileNotFoundException e.toString():java.io.FileNotFoundException: /usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory), e.getMessage():/usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory) java.io.RandomAccessFile.open(Native Method) java.io.RandomAccessFile.init(RandomAccessFile.java:212) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.init(SimpleFSDirectory.java:71) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(SimpleFSDirectory.java:98) org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFSDirectory.java:92) org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:79) org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345) org.apache.lucene.util.BitVector.init(BitVector.java:266) org.apache.lucene.index.SegmentReader.loadDeletedDocs(SegmentReader.java:160) org.apache.lucene.index.SegmentReader.get(SegmentReader.java:120) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:696) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:671) org.apache.lucene.index.BufferedDeletesStream.applyDeletes(BufferedDeletesStream.java:244) org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3608) org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3545) org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1852) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1812) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1776) com.siap.WebServices.Utility.UtiIndexerLucene.delete(UtiIndexerLucene.java:143) com.siap.WebServices.Utility.UtiIndexerLucene.indexFile(UtiIndexerLucene.java:221) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For
[jira] [Commented] (LUCENE-4467) SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index
[ https://issues.apache.org/jira/browse/LUCENE-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13476027#comment-13476027 ] B.Nicolotti commented on LUCENE-4467: - The problem seems to be really the fact that we had 2 web application writing to the same index from one linux process hosting the tomcat application server. I switched off the indexing from one web application, leaving only the other one writing the index, and it has worked without problems for 3 days. We'll write some lock mechanism between the two web applications. Many thanks Regards SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index Key: LUCENE-4467 URL: https://issues.apache.org/jira/browse/LUCENE-4467 Project: Lucene - Core Issue Type: Bug Affects Versions: 3.6 Environment: Currently using: java -version java version 1.5.0_13 Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_13-b05) Java HotSpot(TM) Client VM (build 1.5.0_13-b05, mixed mode, sharing) Tomcat 5.5 lucene 3.6.0 Reporter: B.Nicolotti Attachments: index.zip We're using lucene to index XML. We've had it in test on a server for some weeks with no problem, but today we've got the error below and the index seems no longer usable. Could you please tell us 1) is there a way to recover the index? 2) is there a way to avoid this error? I can supply the index if needed many thanks Tue Oct 09 17:41:02 CEST 2012:com.siap.WebServices.Utility.UtiIndexerLucene caught an exception: 32225010 java.io.FileNotFoundException e.toString():java.io.FileNotFoundException: /usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory), e.getMessage():/usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory) java.io.RandomAccessFile.open(Native Method) java.io.RandomAccessFile.init(RandomAccessFile.java:212) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.init(SimpleFSDirectory.java:71) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(SimpleFSDirectory.java:98) org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFSDirectory.java:92) org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:79) org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345) org.apache.lucene.util.BitVector.init(BitVector.java:266) org.apache.lucene.index.SegmentReader.loadDeletedDocs(SegmentReader.java:160) org.apache.lucene.index.SegmentReader.get(SegmentReader.java:120) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:696) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:671) org.apache.lucene.index.BufferedDeletesStream.applyDeletes(BufferedDeletesStream.java:244) org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3608) org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3545) org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1852) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1812) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1776) com.siap.WebServices.Utility.UtiIndexerLucene.delete(UtiIndexerLucene.java:143) com.siap.WebServices.Utility.UtiIndexerLucene.indexFile(UtiIndexerLucene.java:221) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-4467) SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index
[ https://issues.apache.org/jira/browse/LUCENE-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13476086#comment-13476086 ] Michael McCandless commented on LUCENE-4467: Hmm, but Lucene has locking (write.lock file in the index) to prevent two IndexWriters from writing to the same index at the same time. The 2nd IndexWriter should have hit a LockObtainFailedException. Are you setting your own LockFactory on the directory? Or just using its default? Which Directory implementation are you using...? SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index Key: LUCENE-4467 URL: https://issues.apache.org/jira/browse/LUCENE-4467 Project: Lucene - Core Issue Type: Bug Affects Versions: 3.6 Environment: Currently using: java -version java version 1.5.0_13 Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_13-b05) Java HotSpot(TM) Client VM (build 1.5.0_13-b05, mixed mode, sharing) Tomcat 5.5 lucene 3.6.0 Reporter: B.Nicolotti Attachments: index.zip We're using lucene to index XML. We've had it in test on a server for some weeks with no problem, but today we've got the error below and the index seems no longer usable. Could you please tell us 1) is there a way to recover the index? 2) is there a way to avoid this error? I can supply the index if needed many thanks Tue Oct 09 17:41:02 CEST 2012:com.siap.WebServices.Utility.UtiIndexerLucene caught an exception: 32225010 java.io.FileNotFoundException e.toString():java.io.FileNotFoundException: /usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory), e.getMessage():/usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory) java.io.RandomAccessFile.open(Native Method) java.io.RandomAccessFile.init(RandomAccessFile.java:212) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.init(SimpleFSDirectory.java:71) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(SimpleFSDirectory.java:98) org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFSDirectory.java:92) org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:79) org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345) org.apache.lucene.util.BitVector.init(BitVector.java:266) org.apache.lucene.index.SegmentReader.loadDeletedDocs(SegmentReader.java:160) org.apache.lucene.index.SegmentReader.get(SegmentReader.java:120) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:696) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:671) org.apache.lucene.index.BufferedDeletesStream.applyDeletes(BufferedDeletesStream.java:244) org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3608) org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3545) org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1852) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1812) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1776) com.siap.WebServices.Utility.UtiIndexerLucene.delete(UtiIndexerLucene.java:143) com.siap.WebServices.Utility.UtiIndexerLucene.indexFile(UtiIndexerLucene.java:221) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-4467) SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index
[ https://issues.apache.org/jira/browse/LUCENE-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13476118#comment-13476118 ] B.Nicolotti commented on LUCENE-4467: - Hello, no we didn't implement any LockFactory class. My doubt is that in this case we've one linux process that's trying to obtain a lock file. If the file is already opened by the process the second is stopped? reviewing tomcat logs we've this error: Fri Oct 05 22:32:20 CEST 2012:com.siap.WebServices.Utility.UtiIndexerLucene caught an exception: 9290338 org.apache.lucene.store.LockObtainFailedException e.toString():org.apache.lucene.store.LockObtainFailedException: Lock obtain timed out: NativeFSLock@/usr/local/WS_DynPkg/logs/index/write.lock, e.getMessage():Lock obtain timed out: NativeFSLock@/usr/local/WS_DynPkg/logs/index/write.lock org.apache.lucene.store.Lock.obtain(Lock.java:84) org.apache.lucene.index.IndexWriter.init(IndexWriter.java:1098) com.siap.WebServices.Utility.UtiIndexerLucene.delete(UtiIndexerLucene.java:139) com.siap.WebServices.Utility.SerLogSearch.deleteIdList(SerLogSearch.java:720 at the time the lock time out was set to 10s. We'll try to switch on 2 application again. many thanks Best regards Bartolomeo SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index Key: LUCENE-4467 URL: https://issues.apache.org/jira/browse/LUCENE-4467 Project: Lucene - Core Issue Type: Bug Affects Versions: 3.6 Environment: Currently using: java -version java version 1.5.0_13 Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_13-b05) Java HotSpot(TM) Client VM (build 1.5.0_13-b05, mixed mode, sharing) Tomcat 5.5 lucene 3.6.0 Reporter: B.Nicolotti Attachments: index.zip We're using lucene to index XML. We've had it in test on a server for some weeks with no problem, but today we've got the error below and the index seems no longer usable. Could you please tell us 1) is there a way to recover the index? 2) is there a way to avoid this error? I can supply the index if needed many thanks Tue Oct 09 17:41:02 CEST 2012:com.siap.WebServices.Utility.UtiIndexerLucene caught an exception: 32225010 java.io.FileNotFoundException e.toString():java.io.FileNotFoundException: /usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory), e.getMessage():/usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory) java.io.RandomAccessFile.open(Native Method) java.io.RandomAccessFile.init(RandomAccessFile.java:212) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.init(SimpleFSDirectory.java:71) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(SimpleFSDirectory.java:98) org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFSDirectory.java:92) org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:79) org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345) org.apache.lucene.util.BitVector.init(BitVector.java:266) org.apache.lucene.index.SegmentReader.loadDeletedDocs(SegmentReader.java:160) org.apache.lucene.index.SegmentReader.get(SegmentReader.java:120) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:696) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:671) org.apache.lucene.index.BufferedDeletesStream.applyDeletes(BufferedDeletesStream.java:244) org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3608) org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3545) org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1852) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1812) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1776) com.siap.WebServices.Utility.UtiIndexerLucene.delete(UtiIndexerLucene.java:143) com.siap.WebServices.Utility.UtiIndexerLucene.indexFile(UtiIndexerLucene.java:221) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-4467) SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index
[ https://issues.apache.org/jira/browse/LUCENE-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13473330#comment-13473330 ] B.Nicolotti commented on LUCENE-4467: - We deleted the index folder this folder and started from empty index, the system worked without problems all the day indexing the xml produced today, until we had another problem, see below. We've 2 web applications in one tomcat java process that write the index. The two web applications use the same version of Lucene, 3.6.0. May this be a problem? Shouldn't each web application obtain the write.lok before to write the index? The index is small, so I can attach it Many thanks Best regards Wed Oct 10 17:34:05 CEST 2012:com.siap.WebServices.Utility.UtiIndexerLucene caught an exception: 16801917 java.io.FileNotFoundException e.toString():java.io.FileNotFoundException: _42.fdt, e.getMessage():_42.fdt org.apache.lucene.store.FSDirectory.fileLength(FSDirectory.java:284) org.apache.lucene.index.SegmentInfo.sizeInBytes(SegmentInfo.java:303) org.apache.lucene.index.TieredMergePolicy.size(TieredMergePolicy.java:635) org.apache.lucene.index.TieredMergePolicy.useCompoundFile(TieredMergePolicy.java:613) org.apache.lucene.index.DocumentsWriter.flush(DocumentsWriter.java:593) org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3580) org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3545) org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1852) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1812) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1776) com.siap.WebServices.Utility.UtiIndexerLucene.indexFile(UtiIndexerLucene.java:272) com.siap.WebServices.Utility.UtiLogPrintingThread.run(UtiLogPrintingThread.java:146) Somma controllo versione: Server info:Apache Tomcat/5.5.23@127.0.0.1(tomcatdemo) SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index Key: LUCENE-4467 URL: https://issues.apache.org/jira/browse/LUCENE-4467 Project: Lucene - Core Issue Type: Bug Affects Versions: 3.6 Environment: Currently using: java -version java version 1.5.0_13 Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_13-b05) Java HotSpot(TM) Client VM (build 1.5.0_13-b05, mixed mode, sharing) Tomcat 5.5 lucene 3.6.0 Reporter: B.Nicolotti Attachments: index.zip We're using lucene to index XML. We've had it in test on a server for some weeks with no problem, but today we've got the error below and the index seems no longer usable. Could you please tell us 1) is there a way to recover the index? 2) is there a way to avoid this error? I can supply the index if needed many thanks Tue Oct 09 17:41:02 CEST 2012:com.siap.WebServices.Utility.UtiIndexerLucene caught an exception: 32225010 java.io.FileNotFoundException e.toString():java.io.FileNotFoundException: /usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory), e.getMessage():/usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory) java.io.RandomAccessFile.open(Native Method) java.io.RandomAccessFile.init(RandomAccessFile.java:212) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.init(SimpleFSDirectory.java:71) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(SimpleFSDirectory.java:98) org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFSDirectory.java:92) org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:79) org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345) org.apache.lucene.util.BitVector.init(BitVector.java:266) org.apache.lucene.index.SegmentReader.loadDeletedDocs(SegmentReader.java:160) org.apache.lucene.index.SegmentReader.get(SegmentReader.java:120) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:696) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:671) org.apache.lucene.index.BufferedDeletesStream.applyDeletes(BufferedDeletesStream.java:244) org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3608) org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3545) org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1852) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1812) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1776) com.siap.WebServices.Utility.UtiIndexerLucene.delete(UtiIndexerLucene.java:143) com.siap.WebServices.Utility.UtiIndexerLucene.indexFile(UtiIndexerLucene.java:221) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (LUCENE-4467) SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index
[ https://issues.apache.org/jira/browse/LUCENE-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13472574#comment-13472574 ] Michael McCandless commented on LUCENE-4467: Hmm can you describe what led up to this? Is it easy to reproduce? Can you run IndexWriter with an infoStream and post the full log leading up to this? You'll have to .rollback() your IndexWriter when this happens. But then if you try to open IndexReader, I'm curious if it's corrupt or not ... Is there anything (eg backup scripts, syncing indices across machines, etc.) that might touch Lucene's index files directly? SegmentReader.loadDeletedDocs FileNotFoundExceptio load _hko_7.del - corrupted index Key: LUCENE-4467 URL: https://issues.apache.org/jira/browse/LUCENE-4467 Project: Lucene - Core Issue Type: Bug Affects Versions: 3.6 Environment: Currently using: java -version java version 1.5.0_13 Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_13-b05) Java HotSpot(TM) Client VM (build 1.5.0_13-b05, mixed mode, sharing) Tomcat 5.5 lucene 3.6.0 Reporter: B.Nicolotti We're using lucene to index XML. We've had it in test on a server for some weeks with no problem, but today we've got the error below and the index seems no longer usable. Could you please tell us 1) is there a way to recover the index? 2) is there a way to avoid this error? I can supply the index if needed many thanks Tue Oct 09 17:41:02 CEST 2012:com.siap.WebServices.Utility.UtiIndexerLucene caught an exception: 32225010 java.io.FileNotFoundException e.toString():java.io.FileNotFoundException: /usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory), e.getMessage():/usr/local/WS_DynPkg/logs/index/_hko_7.del (No such file or directory) java.io.RandomAccessFile.open(Native Method) java.io.RandomAccessFile.init(RandomAccessFile.java:212) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.init(SimpleFSDirectory.java:71) org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(SimpleFSDirectory.java:98) org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFSDirectory.java:92) org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:79) org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345) org.apache.lucene.util.BitVector.init(BitVector.java:266) org.apache.lucene.index.SegmentReader.loadDeletedDocs(SegmentReader.java:160) org.apache.lucene.index.SegmentReader.get(SegmentReader.java:120) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:696) org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:671) org.apache.lucene.index.BufferedDeletesStream.applyDeletes(BufferedDeletesStream.java:244) org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3608) org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3545) org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1852) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1812) org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1776) com.siap.WebServices.Utility.UtiIndexerLucene.delete(UtiIndexerLucene.java:143) com.siap.WebServices.Utility.UtiIndexerLucene.indexFile(UtiIndexerLucene.java:221) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
