This can happen due to either of these: 1. This is probably due to the content having been trimmed during the fetching. Try setting http.content.limit to a larger value<http://lucene.472066.n3.nabble.com/parse-step-hangs-td961720.html> . 2. If the file is huge, try increasing your parser.timeout setting<http://osdir.com/ml/user.nutch.apache/2011-10/msg00229.html> .
thanks, Tejas Patil On Sun, Oct 14, 2012 at 7:50 PM, 宾军志 <[email protected]> wrote: > Hi All, > > Currently I already have done the installation of nutch2.1 with hbase and > it work well with html parsing. > But when I try to parse a word document I got the below exception: > > 2012-10-14 17:56:04,686 INFO crawl.SignatureFactory - Using Signature > impl: org.apache.nutch.crawl.MD5Signature > 2012-10-14 17:56:05,026 INFO mapreduce.GoraRecordReader - > gora.buffer.read.limit = 10000 > 2012-10-14 17:56:05,048 INFO mapreduce.GoraRecordWriter - > gora.buffer.write.limit = 10000 > 2012-10-14 17:56:05,054 INFO crawl.SignatureFactory - Using Signature > impl: org.apache.nutch.crawl.MD5Signature > 2012-10-14 17:56:05,077 INFO parse.ParserJob - Parsing > > http://www.g12e.com/upload/html/2012/6/25/zhangw8867520120625134724265971.doc > 2012-10-14 17:56:05,077 INFO parse.ParserFactory - The parsing plugins: > [org.apache.nutch.parse.tika.TikaParser] are enabled via the > plugin.includes system property, and all claim to support the content type > application/x-tika-msoffice, but they are not mapped to it in the > parse-plugins.xml file > 2012-10-14 17:56:05,164 ERROR tika.TikaParser - Error parsing > > http://www.g12e.com/upload/html/2012/6/25/zhangw8867520120625134724265971.doc > java.io.IOException: Invalid header signature; read 0x0000000000000000, > expected 0xE11AB1A1E011CFD0 > at org.apache.poi.poifs.storage.HeaderBlock.<init>(HeaderBlock.java:140) > at org.apache.poi.poifs.storage.HeaderBlock.<init>(HeaderBlock.java:115) > at > > org.apache.poi.poifs.filesystem.NPOIFSFileSystem.<init>(NPOIFSFileSystem.java:265) > at > org.apache.tika.parser.microsoft.OfficeParser.parse(OfficeParser.java:170) > at org.apache.nutch.parse.tika.TikaParser.getParse(Unknown Source) > at org.apache.nutch.parse.ParseCallable.call(Unknown Source) > at org.apache.nutch.parse.ParseCallable.call(Unknown Source) > at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) > at java.util.concurrent.FutureTask.run(Unknown Source) > at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) > at java.lang.Thread.run(Unknown Source) > > Then I download this document to my local and try tika parse by command: > ./bin/nutch plugin parse-tika > org.apache.nutch.parse.tika.TikaParser zhangw8867520120625134724265971.doc > This command worked well. > > Anyone has idea about it? > > BR, > > Rock Bin >
