Hello,
I�m still having this problem with "java.io.IOException: File does not
exist".
I now tested the nightly build from 4th of October.
System is running on Windows 2000.
The error occurs with "-local" and without "-local" switch in the crawl
parameter.
Any ideas?
regards
Carsten
------------------------
Again the Log (with only 1 testurl in the file "url"):
$ bin/nutch crawl -local url -dir test -depth 10
041005 135538 loading file:/E:/Search/nutch-nightly/conf/nutch-default.xml
041005 135538 loading file:/E:/Search/nutch-nightly/conf/crawl-tool.xml
041005 135538 loading file:/E:/Search/nutch-nightly/conf/nutch-site.xml
041005 135538 crawl started in: test
041005 135538 rootUrlFile = url
041005 135538 threads = 40
041005 135538 depth = 10
041005 135538 Created webdb at LocalFS,E:\Search\nutch-nightly\test\db
041005 135538 Starting URL processing
041005 135538 Using URL filter: net.nutch.net.RegexURLFilter
041005 135538 found resource crawl-urlfilter.txt at
file:/E:/Search/nutch-night
y/conf/crawl-urlfilter.txt
041005 135538 Using URL normalizer: net.nutch.net.BasicUrlNormalizer
041005 135538 Added 1 pages
041005 135538 Processing pagesByURL: Sorted 1 instructions in 0.016 seconds.
041005 135538 Processing pagesByURL: Sorted 62.5 instructions/second
041005 135538 Processing pagesByURL: Merged to new DB containing 1 records
in 0
0 seconds
041005 135538 Processing pagesByURL: Merged Infinity records/second
041005 135538 Processing pagesByMD5: Sorted 1 instructions in 0.0 seconds.
041005 135538 Processing pagesByMD5: Sorted Infinity instructions/second
041005 135538 Processing pagesByMD5: Merged to new DB containing 1 records
in 0
0 seconds
041005 135538 Processing pagesByMD5: Merged Infinity records/second
041005 135539 Processing linksByMD5: Copied file (0 bytes) in 0.0 secs.
041005 135539 Processing linksByURL: Copied file (0 bytes) in 0.015 secs.
041005 135539 FetchListTool started
java.io.IOException: File does not exist
at net.nutch.util.LocalFileSystem.open(LocalFileSystem.java:123)
at
net.nutch.io.NFSRAFHelper.getFileLength(BufferedRandomAccessFile.jav
:53)
at
net.nutch.io.NFSRandomAccessFile.getFileLength(BufferedRandomAccessF
le.java:220)
at net.nutch.io.SequenceFile$Reader.<init>(SequenceFile.java:140)
at net.nutch.io.SequenceFile$Reader.<init>(SequenceFile.java:133)
at net.nutch.io.MapFile$Reader.<init>(MapFile.java:170)
at net.nutch.db.WebDBReader.<init>(WebDBReader.java:53)
at
net.nutch.tools.FetchListTool.emitFetchList(FetchListTool.java:368)
at
net.nutch.tools.FetchListTool.emitFetchList(FetchListTool.java:304)
at net.nutch.tools.FetchListTool.main(FetchListTool.java:662)
at net.nutch.tools.CrawlTool.main(CrawlTool.java:124)
041005 135539 Overall processing: Sorted 0 entries in 0.0 seconds.
041005 135539 Overall processing: Sorted NaN entries/second
Exception in thread "main" java.io.IOException: File does not exist
at net.nutch.util.LocalFileSystem.open(LocalFileSystem.java:123)
at
net.nutch.io.NFSRAFHelper.getFileLength(BufferedRandomAccessFile.jav
:53)
at
net.nutch.io.NFSRandomAccessFile.getFileLength(BufferedRandomAccessF
le.java:220)
at net.nutch.io.SequenceFile$Reader.<init>(SequenceFile.java:140)
at net.nutch.io.SequenceFile$Reader.<init>(SequenceFile.java:133)
at net.nutch.io.MapFile$Reader.<init>(MapFile.java:170)
at net.nutch.db.WebDBWriter.<init>(WebDBWriter.java:1500)
at net.nutch.db.WebDBWriter.<init>(WebDBWriter.java:1443)
at
net.nutch.tools.FetchListTool.emitFetchList(FetchListTool.java:531)
at
net.nutch.tools.FetchListTool.emitFetchList(FetchListTool.java:304)
at net.nutch.tools.FetchListTool.main(FetchListTool.java:662)
at net.nutch.tools.CrawlTool.main(CrawlTool.java:124)
-------------------------------------------------------
This SF.net email is sponsored by: IT Product Guide on ITManagersJournal
Use IT products in your business? Tell us what you think of them. Give us
Your Opinions, Get Free ThinkGeek Gift Certificates! Click to find out more
http://productguide.itmanagersjournal.com/guidepromo.tmpl
_______________________________________________
Nutch-developers mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/nutch-developers
