Can't open a nutch 1.0 index with luke
Hi, I am getting the following exception when I try to open a nutch 1.0 (I am using the official release) index with Luke (0.9.9.1) java.io.IOException: read past EOF at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput. java:151) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInpu t.java:38) at org.apache.lucene.store.ChecksumIndexInput.readByte(ChecksumIndexInpu t.java:36) at org.apache.lucene.store.IndexInput.readInt(IndexInput.java:70) at org.apache.lucene.store.IndexInput.readLong(IndexInput.java:93) at org.apache.lucene.index.SegmentInfo.init(SegmentInfo.java:203) at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:256) at org.apache.lucene.index.DirectoryReader$1.doBody(DirectoryReader.java :72) at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfo s.java:704) at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:69) at org.apache.lucene.index.IndexReader.open(IndexReader.java:476) at org.apache.lucene.index.IndexReader.open(IndexReader.java:375) at org.getopt.luke.Luke.openIndex(Unknown Source) at org.getopt.luke.Luke.openOk(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at thinlet.Thinlet.invokeImpl(Unknown Source) at thinlet.Thinlet.invoke(Unknown Source) at thinlet.Thinlet.handleMouseEvent(Unknown Source) at thinlet.Thinlet.processEvent(Unknown Source) at java.awt.Component.dispatchEventImpl(Unknown Source) at java.awt.Container.dispatchEventImpl(Unknown Source) at java.awt.Component.dispatchEvent(Unknown Source) at java.awt.LightweightDispatcher.retargetMouseEvent(Unknown Source) at java.awt.LightweightDispatcher.processMouseEvent(Unknown Source) at java.awt.LightweightDispatcher.dispatchEvent(Unknown Source) at java.awt.Container.dispatchEventImpl(Unknown Source) at java.awt.Window.dispatchEventImpl(Unknown Source) at java.awt.Component.dispatchEvent(Unknown Source) at java.awt.EventQueue.dispatchEvent(Unknown Source) at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source) at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source) at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source) at java.awt.EventDispatchThread.pumpEvents(Unknown Source) at java.awt.EventDispatchThread.pumpEvents(Unknown Source) at java.awt.EventDispatchThread.run(Unknown Source) Any ideas why this happens and how to fix it? best regards, Magnus
Re: Can't open a nutch 1.0 index with luke
On 2010-04-01 21:09, Magnús Skúlason wrote: Hi, I am getting the following exception when I try to open a nutch 1.0 (I am using the official release) index with Luke (0.9.9.1) java.io.IOException: read past EOF at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput. java:151) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInpu t.java:38) at org.apache.lucene.store.ChecksumIndexInput.readByte(ChecksumIndexInpu t.java:36) at org.apache.lucene.store.IndexInput.readInt(IndexInput.java:70) at org.apache.lucene.store.IndexInput.readLong(IndexInput.java:93) at org.apache.lucene.index.SegmentInfo.init(SegmentInfo.java:203) at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:256) at org.apache.lucene.index.DirectoryReader$1.doBody(DirectoryReader.java :72) at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfo s.java:704) at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:69) at org.apache.lucene.index.IndexReader.open(IndexReader.java:476) at org.apache.lucene.index.IndexReader.open(IndexReader.java:375) at org.getopt.luke.Luke.openIndex(Unknown Source) at org.getopt.luke.Luke.openOk(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at thinlet.Thinlet.invokeImpl(Unknown Source) at thinlet.Thinlet.invoke(Unknown Source) at thinlet.Thinlet.handleMouseEvent(Unknown Source) at thinlet.Thinlet.processEvent(Unknown Source) at java.awt.Component.dispatchEventImpl(Unknown Source) at java.awt.Container.dispatchEventImpl(Unknown Source) at java.awt.Component.dispatchEvent(Unknown Source) at java.awt.LightweightDispatcher.retargetMouseEvent(Unknown Source) at java.awt.LightweightDispatcher.processMouseEvent(Unknown Source) at java.awt.LightweightDispatcher.dispatchEvent(Unknown Source) at java.awt.Container.dispatchEventImpl(Unknown Source) at java.awt.Window.dispatchEventImpl(Unknown Source) at java.awt.Component.dispatchEvent(Unknown Source) at java.awt.EventQueue.dispatchEvent(Unknown Source) at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source) at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source) at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source) at java.awt.EventDispatchThread.pumpEvents(Unknown Source) at java.awt.EventDispatchThread.pumpEvents(Unknown Source) at java.awt.EventDispatchThread.run(Unknown Source) Any ideas why this happens and how to fix it? Can Nutch itself open this index and use it? I'm not getting any such errors with the above combination and a small test index ... -- Best regards, Andrzej Bialecki ___. ___ ___ ___ _ _ __ [__ || __|__/|__||\/| Information Retrieval, Semantic Web ___|||__|| \| || | Embedded Unix, System Integration http://www.sigram.com Contact: info at sigram dot com
Re: Can't open a nutch 1.0 index with luke
Hi, I found the problem, I could open the index on my server (Linux) but not on my desktop (Windows) so something must be messed up in transfering the files (FTP), same thing used to work just fine with nutch-0.9. I tried to zip it on the server and then unzip it on the windows and then I can open the index just fine. Thanks for the suggestion about trying to open the index with nutch, I had only tried that in my app on the server side (and saw that working fine), therefore on the Windows side I just thought it was Luke that could not open it. best regards, Magnus On Thu, Apr 1, 2010 at 9:20 PM, Andrzej Bialecki a...@getopt.org wrote: On 2010-04-01 21:09, Magnús Skúlason wrote: Hi, I am getting the following exception when I try to open a nutch 1.0 (I am using the official release) index with Luke (0.9.9.1) java.io.IOException: read past EOF at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput. java:151) at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInpu t.java:38) at org.apache.lucene.store.ChecksumIndexInput.readByte(ChecksumIndexInpu t.java:36) at org.apache.lucene.store.IndexInput.readInt(IndexInput.java:70) at org.apache.lucene.store.IndexInput.readLong(IndexInput.java:93) at org.apache.lucene.index.SegmentInfo.init(SegmentInfo.java:203) at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:256) at org.apache.lucene.index.DirectoryReader$1.doBody(DirectoryReader.java :72) at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfo s.java:704) at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:69) at org.apache.lucene.index.IndexReader.open(IndexReader.java:476) at org.apache.lucene.index.IndexReader.open(IndexReader.java:375) at org.getopt.luke.Luke.openIndex(Unknown Source) at org.getopt.luke.Luke.openOk(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at thinlet.Thinlet.invokeImpl(Unknown Source) at thinlet.Thinlet.invoke(Unknown Source) at thinlet.Thinlet.handleMouseEvent(Unknown Source) at thinlet.Thinlet.processEvent(Unknown Source) at java.awt.Component.dispatchEventImpl(Unknown Source) at java.awt.Container.dispatchEventImpl(Unknown Source) at java.awt.Component.dispatchEvent(Unknown Source) at java.awt.LightweightDispatcher.retargetMouseEvent(Unknown Source) at java.awt.LightweightDispatcher.processMouseEvent(Unknown Source) at java.awt.LightweightDispatcher.dispatchEvent(Unknown Source) at java.awt.Container.dispatchEventImpl(Unknown Source) at java.awt.Window.dispatchEventImpl(Unknown Source) at java.awt.Component.dispatchEvent(Unknown Source) at java.awt.EventQueue.dispatchEvent(Unknown Source) at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source) at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source) at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source) at java.awt.EventDispatchThread.pumpEvents(Unknown Source) at java.awt.EventDispatchThread.pumpEvents(Unknown Source) at java.awt.EventDispatchThread.run(Unknown Source) Any ideas why this happens and how to fix it? Can Nutch itself open this index and use it? I'm not getting any such errors with the above combination and a small test index ... -- Best regards, Andrzej Bialecki ___. ___ ___ ___ _ _ __ [__ || __|__/|__||\/| Information Retrieval, Semantic Web ___|||__|| \| || | Embedded Unix, System Integration http://www.sigram.com Contact: info at sigram dot com
