Oozie will execute each script as a 1 Mapper 0 reducer job. Therefore you can think of it as a normal mapper job with 100 mapper tasks and hence these tasks will be distributed across cluster accordingly.
In case you are looking for something that would run a set of commands across all nodes in your cluster, you can see if parallel-ssh <https://github.com/pkittenis/parallel-ssh> suits your requirements. Thanks Satbeer On Wed, Apr 1, 2015 at 11:52 AM, Bhagaban Khatai <[email protected]> wrote: > Our requirement is 100 script would run from different node via oozie (can > be a shell action or SSH action), in this scenario what best option you can > advice. so that it will distribute across all nodes and do some load > balancing. I doutb if many script will run in one perticular node then it > might choke the system. > > Your help would be greatly appriciated. > > On Wed, Apr 1, 2015 at 11:32 AM, Alejandro Abdelnur <[email protected]> > wrote: > > > oozie simply submits the job to run the script to the cluster, it is up > to > > the cluster scheduler what nodes are allocated. > > > > hth > > > > Alejandro > > > > > On Mar 31, 2015, at 22:56, Bhagaban Khatai <[email protected]> > > wrote: > > > > > > Hi, > > > > > > Can someone explain me, if oozie doing the load distribution in the > > > cluster. I have to submit 100 shell script using fork, will it equally > > > distribute across all nodes. > > > > > > Need a little depth knowledge on oozie load balancing. > > > > > > Please help > > >
