Hi anupamk, Ozzie didn't see your plugins and other jars. You should create lib directory in your workspace. An then you should copy plugins directory, lib directory and job file as jar file.
Talat 22 May 2014 01:30 tarihinde "anupamk" <[email protected]> yazdı: > Hi, > > I have oozie workflow that does a nutch crawl I designed using hue. > > All steps in the process work, except for indexing to solr. > > The oozie action that defines the solrindex is as follows > > [code] > <start to="solr-test"/> > <action name="solr-test"> > <java> > <job-tracker>${jobTracker}</job-tracker> > <name-node>${nameNode}</name-node> > <main-class>org.apache.nutch.indexer.IndexingJob</main-class> > > <java-opts>solr.server.url=http://ip-redacted:8983/solr/raw</java-opts> > <arg>hdfs://ip-redacted:8020/user/admin/c</arg> > <arg>-dir</arg> > <arg>hdfs://ip-redacted:8020/user/admin/s000</arg> > </java> > <ok to="end"/> > <error to="kill"/> > </action> > <kill name="kill"> > <message>Action failed, error > message[${wf:errorMessage(wf:lastErrorNode())}]</message> > </kill> > <end name="end"/> > [/code] > > But when I execute the action, the action exits with error status -1. > > The stderr of the job says :: > > [code] > Log Length: 122 > Intercepting System.exit(-1) > Failing Oozie Launcher, Main class > [org.apache.oozie.action.hadoop.JavaMain], exit code [-1] > [/code] > > The syslog says:: > > [code] > 2014-05-21 18:01:50,759 ERROR [main] org.apache.nutch.indexer.IndexingJob: > Indexer: java.lang.RuntimeException: org.apache.nutch.indexer.IndexWriter > not found. > at org.apache.nutch.indexer.IndexWriters.<init>(IndexWriters.java:51) > at org.apache.nutch.indexer.IndexingJob.index(IndexingJob.java:100) > at org.apache.nutch.indexer.IndexingJob.run(IndexingJob.java:185) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > at org.apache.nutch.indexer.IndexingJob.main(IndexingJob.java:195) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.oozie.action.hadoop.JavaMain.run(JavaMain.java:55) > at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:38) > at org.apache.oozie.action.hadoop.JavaMain.main(JavaMain.java:36) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:225) > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:430) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:167) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1557) > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) > [/code] > > > I have verified that the class exists in the apache-nutch-1.7.jar file. > > Also, other actions, like inject, generate, fetch, parse work fine. > > It's only solrindex step that fails and I don't know what to do to fix it. > Any input on this will be great! > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Nutch-deployment-on-hadoop-will-not-index-to-solr-tp4137498.html > Sent from the Nutch - User mailing list archive at Nabble.com. >
