It's better to run map-reduce using built in map-reduce action. and don't try to invent your own. 1. Try to move to separate custom java actions your setup/cleanup code 2. use built in map-reduce.
Oozie knows nothing about spawned MR job in your action. And you would have to reinvent oozie functionality in your current implementation. 2013/10/23 Chetan <[email protected]> > Hi, > > I am trying to execute Oozie Application, which has a single "Java Action" > step to execute Map/Reduce job using a driver program. I am using Java > Action instead of using Map-Reduce action to execute M/R job, since I want > to do some additional setup/cleanup using driver program prior to > submitting job. > > The M/R job that I am trying to submit has some dependencies on third party > jars. I have included these dependencies in my application/lib folder. I > have also added those to /user/oozie/share/lib folder as well. > > Following is the snippet from job.properties. > > oozie.libpath=${nameNode}/user/oozie/share/lib > oozie.use.system.libpath=true > > However, when I run this application, M/R job fails since its not able to > find some dependency classes. I feel that Oozie is adding all the > dependency libs to the classpath of Java action itself. However not to the > M/R job that is being submitted by the java action. > > Is there any way to get around this ? How could I make Oozie to set the > classpath for M/R job, either pointing to application/lib OR > /user/oozie/share/lib ? > > Thanks, Chetan >
