Inserting a field back to same position in a bag

2014-05-12 Thread unmesha sreeveni
Inserting a field back to same position in a bag up vote1down votefavorite *1* I am having an inputfile.c

Re: Query : Filtering out string from a field

2014-05-12 Thread Pradeep Gollakota
Kartik, Looks like you're facing this issues: https://issues.apache.org/jira/browse/PIG-2507 What version of Pig are you using? The issue is fixed in 0.11.2 and 0.12. So if you upgrade to these versions, your problem should go away. If you're unable to upgrade for some reason, your best bet is to

Re: Query : Filtering out string from a field

2014-05-12 Thread kartik manocha
Thanks, it could be due to this bug as I'm using 0.11,1. Upgrade isn't an option feasible for me at the moment. Will try exploring writing UDF's, btw thanks for the quick response. Thanks, Kartik On Mon, May 12, 2014 at 9:11 PM, Pradeep Gollakota wrote: > Kartik, > > Looks like you're facing

Re: pass command line parameters to custom LOAD

2014-05-12 Thread unmesha sreeveni
​You can go through this link http://www.unmeshasreeveni.blogspot.in/2014/04/custom-parameters-to-pig-script.html Hope this answers your question. ​ On Tue, May 6, 2014 at 1:54 PM, Patcharee Thongtra < patcharee.thong...@uni.no> wrote: > Hi, > > How can I pass command line parameters to my cu

Re: disable jython logging for pig embedded in python

2014-05-12 Thread Jerry Lam
Hello everyone, For those who are also interested in reducing the log from pig in python embedded mode, setting the following before executing the pig script will suppress the above logs: export PIG_OPTS=-Dpython.verbose=warning Cheers~ Jerry On Mon, May 12, 2014 at 10:20 AM, Jerry Lam wrote:

Re: disable jython logging for pig embedded in python

2014-05-12 Thread Jerry Lam
Hello everyone, I still cannot disable the logging noted above when I use pig embedded in python. Any help is appreciated. Best Regards, Jerry On Wed, May 7, 2014 at 2:43 PM, Jerry Lam wrote: > Hi pig users, > > does anyone know how to disable jython logging? > More specifically, when I run

Re: pass command line parameters to custom LOAD

2014-05-12 Thread unmesha sreeveni
How did u pass the argument? Try this and see PigStorage('$param') -param param="," On Mon, May 12, 2014 at 4:31 PM, unmesha sreeveni wrote: > > On Mon, May 12, 2014 at 1:22 PM, Patcharee Thongtra < > patcharee.thong...@uni.no> wrote: > >> function > > > ​Hi > You wrote UDF or ?​ > > > > --

Re: pass command line parameters to custom LOAD

2014-05-12 Thread unmesha sreeveni
On Mon, May 12, 2014 at 1:22 PM, Patcharee Thongtra < patcharee.thong...@uni.no> wrote: > function ​Hi You wrote UDF or ?​ -- *Thanks & Regards * *Unmesha Sreeveni U.B* *Hadoop, Bigdata Developer* *Center for Cyber Security | Amrita Vishwa Vidyapeetham* http://www.unmeshasreeveni.blogspot

Re: Query : Filtering out string from a field

2014-05-12 Thread kartik manocha
Pradeep, Thanks for the pointers, but as i mentioned that I need to extract that string till semicolon, so facing issues with that. I need to print it before semiclon that's causing pain as when I mention semicolon in regex it treats it as end of statement & produces error. However without menti

Re: pass command line parameters to custom LOAD

2014-05-12 Thread Patcharee Thongtra
Hi, I implemented my own LOAD function, didn't use PigStorage. When I tried MyLOAD($param) which is analogous to PigStorage($param), it did not work. Patcharee On 05/07/2014 06:33 AM, unmesha sreeveni wrote: ​You can go through this link http://www.unmeshasreeveni.blogspot.in/2014/04/custom

Re: Query : Filtering out string from a field

2014-05-12 Thread unmesha sreeveni
Hi Karthik I am also having the same issue. Mine is I want to filter a column instead of a field and join to another file into a specific index. I think someone here can suggest a better solution. On Mon, May 12, 2014 at 12:46 PM, kartik manocha wrote: > Hi, > > I am new to pig & facing an

Re: issue applying variable to LIMIT

2014-05-12 Thread Skanda
Hi, I'm using pig 0.11.0 that comes with CDH 4.4.0. Thanks, Skanda On Fri, May 9, 2014 at 10:44 AM, Skanda wrote: > Hi All, > > I have a use case to get the get N distinct url's based on the number of > hits and their latest timestamp. Pls find below the snippet of the pig > script that I hav

Re: Query : Filtering out string from a field

2014-05-12 Thread Pradeep Gollakota
Check out http://archive.cloudera.com/cdh/3/pig/piglatin_ref2.html#REGEX_EXTRACT This may suit your needs On Mon, May 12, 2014 at 12:16 AM, kartik manocha wrote: > Hi, > > I am new to pig & facing an issue in filtering out a string from a field, > mentioned is the scenario. > > - > I am loading

Query : Filtering out string from a field

2014-05-12 Thread kartik manocha
Hi, I am new to pig & facing an issue in filtering out a string from a field, mentioned is the scenario. - > I am loading data with several fields, among those fields there is field name called 'test_data' - > There are lot of things in this field, I wanted to filter out a string from this field