Hello dear :
I have the following running information from “hadoop.log”
when I configured Nutch 1.3 in Eclipse (Win 7), but I don’t know how to resolve
it ,Can you help me . I’m new to nutch , so forgive me for some mistakes of
using wrong terminology!
2011-11-03 16:51:53,300 WARN crawl.Crawl - solrUrl is not set, indexing will
be skipped...
2011-11-03 16:51:53,502 INFO crawl.Crawl - crawl started in: crawl
2011-11-03 16:51:53,502 INFO crawl.Crawl - rootUrlDir = urls
2011-11-03 16:51:53,502 INFO crawl.Crawl - threads = 4
2011-11-03 16:51:53,502 INFO crawl.Crawl - depth = 5
2011-11-03 16:51:53,502 INFO crawl.Crawl - solrUrl=null
2011-11-03 16:51:53,502 INFO crawl.Crawl - topN = 10
2011-11-03 16:51:53,518 INFO crawl.Injector - Injector: starting at 2011-11-03
16:51:53
2011-11-03 16:51:53,518 INFO crawl.Injector - Injector: crawlDb: crawl/crawldb
2011-11-03 16:51:53,518 INFO crawl.Injector - Injector: urlDir: urls
2011-11-03 16:51:53,534 INFO crawl.Injector - Injector: Converting injected
urls to crawl db entries.
2011-11-03 16:51:53,658 WARN mapred.JobClient - No job jar file set. User
classes may not be found. See JobConf(Class) or JobConf#setJar(String).
2011-11-03 16:51:54,267 INFO plugin.PluginRepository - Plugins: looking in:
E:\IdealTimes\WorkSpace\Nutch1.3\plugin
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - Plugin Auto-activation
mode: [true]
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - Registered Plugins:
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - the nutch core
extension points (nutch-extensionpoints)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - Basic URL Normalizer
(urlnormalizer-basic)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - Html Parse Plug-in
(parse-html)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - Basic Indexing Filter
(index-basic)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - HTTP Framework
(lib-http)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - Pass-through URL
Normalizer (urlnormalizer-pass)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - Regex URL Filter
(urlfilter-regex)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - Http Protocol Plug-in
(protocol-http)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - Regex URL Normalizer
(urlnormalizer-regex)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - Tika Parser Plug-in
(parse-tika)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - OPIC Scoring Plug-in
(scoring-opic)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - CyberNeko HTML Parser
(lib-nekohtml)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - Anchor Indexing Filter
(index-anchor)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - Regex URL Filter
Framework (lib-regex-filter)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - Registered
Extension-Points:
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - Nutch URL Normalizer
(org.apache.nutch.net.URLNormalizer)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - Nutch Protocol
(org.apache.nutch.protocol.Protocol)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - Nutch Segment Merge
Filter (org.apache.nutch.segment.SegmentMergeFilter)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - Nutch URL Filter
(org.apache.nutch.net.URLFilter)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - Nutch Indexing Filter
(org.apache.nutch.indexer.IndexingFilter)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - HTML Parse Filter
(org.apache.nutch.parse.HtmlParseFilter)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - Nutch Content Parser
(org.apache.nutch.parse.Parser)
2011-11-03 16:51:54,345 INFO plugin.PluginRepository - Nutch Scoring
(org.apache.nutch.scoring.ScoringFilter)
2011-11-03 16:51:54,345 WARN net.URLNormalizers -
URLNormalizers:PluginRuntimeException when initializing url normalizer plugin
urlnormalizer-basic instance in getURLNormalizers function: attempting to
continue instantiating plugins
2011-11-03 16:51:54,360 WARN net.URLNormalizers -
URLNormalizers:PluginRuntimeException when initializing url normalizer plugin
urlnormalizer-regex instance in getURLNormalizers function: attempting to
continue instantiating plugins
2011-11-03 16:51:54,360 WARN net.URLNormalizers -
URLNormalizers:PluginRuntimeException when initializing url normalizer plugin
urlnormalizer-pass instance in getURLNormalizers function: attempting to
continue instantiating plugins
2011-11-03 16:51:54,360 WARN mapred.LocalJobRunner - job_local_0001
java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException:
org.apache.nutch.plugin.PluginRuntimeException:
java.lang.ClassNotFoundException:
org.apache.nutch.urlfilter.regex.RegexURLFilter
at org.apache.nutch.net.URLFilters.<init>(URLFilters.java:77)
at
org.apache.nutch.crawl.Injector$InjectMapper.configure(Injector.java:72)
... 18 more
Caused by: org.apache.nutch.plugin.PluginRuntimeException:
java.lang.ClassNotFoundException:
org.apache.nutch.urlfilter.regex.RegexURLFilter
at
org.apache.nutch.plugin.Extension.getExtensionInstance(Extension.java:166)
at org.apache.nutch.net.URLFilters.<init>(URLFilters.java:57)
... 19 more
Caused by: java.lang.ClassNotFoundException:
org.apache.nutch.urlfilter.regex.RegexURLFilter
at java.net.URLClassLoader$1.run(Unknown Source)
at java.net.URLClassLoader$1.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
at
org.apache.nutch.plugin.Extension.getExtensionInstance(Extension.java:156)
... 20 more
Best withes !
Skiming_zhang
