Santhosh Srinivasan commented on PIG-650:

The order in which the properties are applied are:

1. hadoop-site.xml from a static cluster or from hod
2. hadopp-site.xml from pig
3. user specified properties on the command line

In terms of one overriding the other, its in the reverse order

1. user specified properties on the command line overrides
2. hadopp-site.xml from pig which overrides
3. hadoop-site.xml from a static cluster or from hod

I noticed that I have a change in my patch which is not required, I will 
resubmit a patch with this change removed.

-            jobClient = new JobClient(new JobConf(configuration));
+            JobConf jobConf = new JobConf(configuration);
+            jobConf.addResource("pig-cluster-hadoop-site.xml");
+            jobClient = new JobClient(jobConf);

> pig should look for and use the pig specific 'pig-cluster-hadoop-site.xml' in 
> the non HOD case just like it does in the HOD case
> --------------------------------------------------------------------------------------------------------------------------------
>                 Key: PIG-650
>                 URL: https://issues.apache.org/jira/browse/PIG-650
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: types_branch
>            Reporter: Pradeep Kamath
>            Assignee: Santhosh Srinivasan
>             Fix For: types_branch
>         Attachments: PIG-650.patch
> Currently users can create a pig-cluster-hadoop-site.xml with pig specific 
> overrides for hadoop properties for use on the cluster. This file is searched 
> for in the classpath and used in the HOD case but not in the non HOD case. We 
> should also do the same in the non HOD case.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

Reply via email to