Re: Change NN and JobTracker dynamically during runtime

2016-12-05 Thread mdk-swandha
You mean I have to set env variables for each job/workflow execution and then it will be picked up by Oozie. And I should set them in my service (the service which is finding the best cluster?). For example let say I have 3 cluster: - When a job is sent via Oozie/Hue/Zepellin/Livy etc. - they are

Re: Change NN and JobTracker dynamically during runtime

2016-12-05 Thread Andras Piros
Hi Dipesh, during workflow / job submission you can define variables inside job.properties coming e.g. from env vars that are used in workflow.xml. So much for the flexibility. Can you tell me a use case where runtime routing to different JT / NN instances via Oozie (and not e.g. coming from a

Change NN and JobTracker dynamically during runtime

2016-12-01 Thread mdk-swandha
Hi, I have a use case like this - in a multi cluster (hadoop cluster) environment if I would like to send a job/oozie workflow to a desired cluster during runtime, how can this be done. I see that there is JavaActionExecutor class which read NN and JobTracker in createBaseHadoopConf method All