Hi Jason The bottom of your log contains a useful clue
*Caused by: java.lang.NoClassDefFoundError: org/apache/tika/mime/MimeTypeException at org.apache.nutch.indexer.more.MoreIndexingFilter.setConf(MoreIndexingFilter.java:291) at org.apache.nutch.plugin.Extension.getExtensionInstance(Extension.java:162) at org.apache.nutch.indexer.IndexingFilters.<init>(IndexingFilters.java:69) at org.apache.nutch.indexer.IndexerMapReduce.configure(IndexerMapReduce.java:65) ... 22 more Caused by: java.lang.ClassNotFoundException: org.apache.tika.mime.MimeTypeException at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) ... 26 more* * * for some reason it does not seem to find tika-core-1.2.jar. I assume that you are calling "runtime/deploy/nutch" , can you check that the job file contains the tika lib? HTH Julien On 1 November 2012 14:00, Jason Stubblefield <[email protected]>wrote: > Hello, > > I am trying to run the solrindex command from a hadoop cluster in > distributed mode, however when I run the following command, I get an "Error > in configuring object" message: > > bin/nutch solrindex http://176.34.241.135:8983/solr/ crawl/crawldb > -linkdb crawl/linkdb crawl/segments/20121030152842 > > All other functions seem to be working properly, including crawling > parsing, etc… I'm guessing this is something to do with solr but I don't > know what the problem could be. > > The solr server is running properly, and running the same command in local > mode with the same data works. There doesn't seem to be any useful data in > the hadoop.log. I have confirmed the NUTCH_CONF_DIR and NUTCH_HOME are set > and correct. > > Any ideas? Thanks! > > ~Jason > > java.lang.RuntimeException: Error in configuring object > at > org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93) > at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64) > at > org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117) > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:432) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372) > at org.apache.hadoop.mapred.Child$4.run(Child.java:255) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:396) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121) > at org.apache.hadoop.mapred.Child.main(Child.java:249) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88) > ... 9 more > Caused by: java.lang.RuntimeException: Error in configuring object > at > org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93) > at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64) > at > org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117) > at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34) > ... 14 more > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88) > ... 17 more > > > -- * *Open Source Solutions for Text Engineering http://digitalpebble.blogspot.com/ http://www.digitalpebble.com http://twitter.com/digitalpebble
