Re: Retrieving Pig script from MR job config

2016-06-01 Thread Rohini Palaniswamy
It should be there in the job conf ( https://github.com/apache/pig/blob/branch-0.12/src/org/apache/pig/tools/pigstats/ScriptState.java#L112). I have used it even with Pig 0.10. You can use pig.logical.plan.signature configuration. Refer https://issues.apache.org/jira/browse/PIG-2587. On Sat,

Re: Retrieving Pig script from MR job config

2016-05-28 Thread Harish Gopalan
Hi Rohini, Thanks. But I couldn't find any property such as pig.script in my current Pig version i.e pig 0.12 , the closest I could find is pig.script.id , if not the pig script , is there a way for me to fingerprint every pig script that is run on the system i.e YARN ? In other words I would

Re: Retrieving Pig script from MR job config

2016-05-27 Thread Rohini Palaniswamy
You can find the pig script in pig.script setting. It is base64 encoded and you will have to decode it. If the script is too long, it will be truncated to 10K lines. Regards, Rohini On Tue, May 10, 2016 at 7:27 AM, Harish Gopalan wrote: > Hi, > > Is it possible to

Retrieving Pig script from MR job config

2016-05-10 Thread Harish Gopalan
Hi, Is it possible to retrieve the original pig script from the MR job configuration similar to hive i.e hive.query.string. I tried to deserialize pig.pigContext value from the MR job configuration but couldn't get it ? Please advise. Regards Harish