[ 
https://issues.apache.org/jira/browse/OOZIE-381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13101822#comment-13101822
 ] 

Hadoop QA commented on OOZIE-381:
---------------------------------

deepikakhera remarked:
Hi Mohammad,

I needed the feature now, so I did a quick patch to get it working (did it for 
version 2.2 for oozie. Now ,  I plan to use it for 2.3). Basically the issue 
was that JavaActionExecutor.getActionFileSystem(Context context, Element 
actionXml), is not using the filesystem from actionXml (which has the 
configuration for the second job that is to be run in the other 
cluster).Instead it uses the filesystem of workflow.

The exception I got (when tested with version 2.2) is:

IllegalArgumentException: Wrong FS: 
hdfs://cluster1namenode:9000/user/Deepika/oozie-root/0000006-110201204059448-oozie-root-W/cluster1job1--map-reduce,
 expected: hdfs://cluster2namenode:9000.

The workflow directory here is cluster1. The exception is thrown when the 
workflow tries to run a map reduce job in cluster2.

In my patch, I modified the getActionFileSystem method to use the filesystem 
from the actionXml for "map reduce jobs", when that is present.

I can submit the patch, if you think it will be useful - until the permanent 
fix is out in version 3.0.

Thanks,
Deepika

> GH-616: Unable to run a map reduce job in a cluster different from where 
> Oozie is running.
> ------------------------------------------------------------------------------------------
>
>                 Key: OOZIE-381
>                 URL: https://issues.apache.org/jira/browse/OOZIE-381
>             Project: Oozie
>          Issue Type: Bug
>            Reporter: Hadoop QA
>
> If a map reduce job is configured to run on a cluster different from the 
> cluster on which Oozie is running, it fails with error.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to