Oozie workflow actions are at the granularity of a map-reduce job and nothing finer. For what you are looking for, you could create two MR jobs -- the first one with map only (identity reducer) and the second one reduce only (identity mapper) -- and then coordinate them with oozie.
The MR framework doesn't allow for pausing between map and reduce for the simple reason that keeping track of the intermediate results (which are on local disk and NOT on hdfs) and the corresponding jobs will be troublesome. My $0.02, KP -----Original Message----- From: xeonmailinglist [mailto:[email protected]] Sent: Wednesday, February 18, 2015 1:10 PM To: [email protected] Subject: Re: Oozie works with YARN? It is a pure map-reduce job. Can I create an oozie workflow in java with actions like mentioned? On 18-02-2015 21:02, Serega Sheypak wrote: > what is job? > Is it pure map-reduce | pig | hive? > Oozie is workflow runner and a kind of the cron (later oozie versions). > You can split you job in actions (oozie terminology). > 1. run smth > 2. validate result of smth > 3. decision node: if validation ok, then continue, else fail. > > > 2015-02-18 23:56 GMT+03:00 xeonmailinglist <[email protected]>: > >> I want to suspend a mapreduce job when the map tasks finish, execute >> some code to validated data, and resume the job. >> AFAIK, YARN doesn't have a way to suspend and resume running jobs. So >> I was in using oozie to do this. >> >> Is this possible in Oozie? >> >> >> >> On 18-02-2015 20:50, Serega Sheypak wrote: >> >>> are trying to do? >>> Generally, it works w/o any problems. >>> >>
