Re: MiniOozie for local dryrun or other options for doing dryrun of oozie workflows?

If you get MiniOozie to work, it should start Mini HDFS and a Mini MapReduce (Yarn + MR or just MR depending on Hadoop 1 or Hadoop 2) clusters. There are methods in the parent class to get the URIs for these. That should let you submit workflows containing most action types. For ones that require

Re: MiniOozie for local dryrun or other options for doing dryrun of oozie workflows?

Yeah, I see it. I found the way to test wokflow locally but it's suuuper complex. I have to start local MR, Local HDFS and Local OOzie things. Then I do mock on the fly xml actions with my test actions and run workflow. It's super complex and fragile unfortunately... I'll try to reach dev group. I

Re: MiniOozie for local dryrun or other options for doing dryrun of oozie workflows?

Hi Serega, as per *Oozie documentation * we can see that with -dryrun option does not create nor run a job. So for the killer feature request, I think it's not possible ATM. Regards, Andras -- Andras PIROS Softw

Re: MiniOozie for local dryrun or other options for doing dryrun of oozie workflows?

Hi, thanks for the reply. I did hit many issues with MiniOoze from CDH 5.5.1 (Oozie 4.1 + some Cloudera patches on top of it) 1. It doesn't work without oozie git repo. I've fixed it. 2. I wasn't able to run LocalOoize. I'm using DagEngine directly. dryrun works fine. And what if I want to execute

Re: MiniOozie for local dryrun or other options for doing dryrun of oozie workflows?

Hi Serega, It turns out that LocalOozieClient is missing some methods that it should be implementing to call DagEngine (see OOZIE-2751 ). One of those is the dryrun method, which is why that's not working for you. For now, calling DagEngine direc

MiniOozie for local dryrun or other options for doing dryrun of oozie workflows?

Hi, did anyone make it work property in his project? I need to do dry run for my workflows. The usecase is: User writes workflow and wants to: 1. Check if it valid 2. do dryrun, see how it flows without executing steps. Let say I have wflow with three steps: 1. disctp data from $A to $B 2. run sp

MiniOozie for local dryrun or other options for doing dryrun of oozie workflows?

Hi, did anyone make it work property in his project? I need to do dry run for my workflows. The usecase is: User writes workflow and wants to: 1. Check if it valid 2. do dryrun, see how it flows without executing steps. Let say I have wflow with three steps: 1. disctp data from $A to $B 2. run sp