You need to follow the tutorial here http://wiki.apache.org/nutch/RunNutchInEclipse If after reading this thoroughly you have some problems please let us know about them. Thank you Lewis
On Thu, May 16, 2013 at 12:07 PM, harsh yadav <[email protected]> wrote: > 2013-05-17 00:33:09,376 WARN crawl.Crawl (Crawl.java:run(97)) - solrUrl is > not set, indexing will be skipped... > 2013-05-17 00:33:09,522 INFO crawl.Crawl (Crawl.java:run(108)) - crawl > started in: crawl > 2013-05-17 00:33:09,523 INFO crawl.Crawl (Crawl.java:run(109)) - > rootUrlDir = urls > 2013-05-17 00:33:09,523 INFO crawl.Crawl (Crawl.java:run(110)) - threads = > 10 > 2013-05-17 00:33:09,523 INFO crawl.Crawl (Crawl.java:run(111)) - depth = 3 > 2013-05-17 00:33:09,523 INFO crawl.Crawl (Crawl.java:run(112)) - > solrUrl=null > 2013-05-17 00:33:09,524 INFO crawl.Crawl (Crawl.java:run(114)) - topN = 50 > 2013-05-17 00:33:09,534 INFO crawl.Injector (Injector.java:inject(257)) - > Injector: starting at 2013-05-17 00:33:09 > 2013-05-17 00:33:09,535 INFO crawl.Injector (Injector.java:inject(258)) - > Injector: crawlDb: crawl/crawldb > 2013-05-17 00:33:09,535 INFO crawl.Injector (Injector.java:inject(259)) - > Injector: urlDir: urls > 2013-05-17 00:33:09,583 INFO crawl.Injector (Injector.java:inject(269)) - > Injector: Converting injected urls to crawl db entries. > 2013-05-17 00:33:09,610 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - > Initializing JVM Metrics with processName=JobTracker, sessionId= > 2013-05-17 00:33:09,663 WARN mapred.JobClient > (JobClient.java:configureCommandLineOptions(661)) - No job jar file set. > User classes may not be found. See JobConf(Class) or > JobConf#setJar(String). > 2013-05-17 00:33:09,678 INFO mapred.FileInputFormat > (FileInputFormat.java:listStatus(192)) - Total input paths to process : 1 > 2013-05-17 00:33:10,158 INFO mapred.JobClient > (JobClient.java:monitorAndPrintJob(1275)) - Running job: job_local_0001 > 2013-05-17 00:33:10,161 INFO mapred.FileInputFormat > (FileInputFormat.java:listStatus(192)) - Total input paths to process : 1 > 2013-05-17 00:33:10,212 INFO mapred.MapTask > (MapTask.java:runOldMapper(347)) - numReduceTasks: 1 > 2013-05-17 00:33:10,217 INFO mapred.MapTask (MapTask.java:<init>(776)) - > io.sort.mb = 100 > 2013-05-17 00:33:10,241 INFO mapred.MapTask (MapTask.java:<init>(788)) - > data buffer = 79691776/99614720 > 2013-05-17 00:33:10,241 INFO mapred.MapTask (MapTask.java:<init>(789)) - > record buffer = 262144/327680 > 2013-05-17 00:33:10,251 WARN plugin.PluginRepository > (PluginManifestParser.java:getPluginFolder(123)) - Plugins: directory not > found: plugins > 2013-05-17 00:33:10,252 INFO plugin.PluginRepository > (PluginRepository.java:displayStatus(313)) - Plugin Auto-activation mode: > [true] > 2013-05-17 00:33:10,252 INFO plugin.PluginRepository > (PluginRepository.java:displayStatus(314)) - Registered Plugins: > 2013-05-17 00:33:10,252 INFO plugin.PluginRepository > (PluginRepository.java:displayStatus(317)) - NONE > 2013-05-17 00:33:10,252 INFO plugin.PluginRepository > (PluginRepository.java:displayStatus(324)) - Registered Extension-Points: > 2013-05-17 00:33:10,253 INFO plugin.PluginRepository > (PluginRepository.java:displayStatus(326)) - NONE > 2013-05-17 00:33:10,255 WARN mapred.LocalJobRunner > (LocalJobRunner.java:run(256)) - job_local_0001 > java.lang.RuntimeException: Error in configuring object > at > org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93) > at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64) > at > > org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117) > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307) > at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) > at java.lang.reflect.Method.invoke(Unknown Source) > at > org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88) > ... 5 more > Caused by: java.lang.RuntimeException: Error in configuring object > at > org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93) > at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64) > at > > org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117) > at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34) > ... 10 more > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) > at java.lang.reflect.Method.invoke(Unknown Source) > at > org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88) > ... 13 more > Caused by: java.lang.RuntimeException: x point > org.apache.nutch.net.URLNormalizer not found. > at org.apache.nutch.net.URLNormalizers.<init>(URLNormalizers.java:123) > at org.apache.nutch.crawl.Injector$InjectMapper.configure(Injector.java:74) > ... 18 more > 2013-05-17 00:33:11,160 INFO mapred.JobClient > (JobClient.java:monitorAndPrintJob(1288)) - map 0% reduce 0% > 2013-05-17 00:33:11,163 INFO mapred.JobClient > (JobClient.java:monitorAndPrintJob(1343)) - Job complete: job_local_0001 > 2013-05-17 00:33:11,164 INFO mapred.JobClient (Counters.java:log(514)) - > Counters: 0 > Exception in thread "main" java.io.IOException: Job failed! > at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1252) > at org.apache.nutch.crawl.Injector.inject(Injector.java:281) > at org.apache.nutch.crawl.Crawl.run(Crawl.java:132) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) > at org.apache.nutch.crawl.Crawl.main(Crawl.java:55) > > > > On Fri, May 17, 2013 at 12:37 AM, harsh yadav <[email protected]> > wrote: > > > Hello, > > > > I am running nutch 1.6 with hadoop 0.20.2 but not able to crawl in eclips > > every time getting error:- > > > > > -- *Lewis*
