Since you integers in this field can you try matching to a regular expression?
Something like: X matches '\\d+' > On Feb 18, 2016, at 12:55 AM, Parth Sawant <parth.sawan...@gmail.com> wrote: > > Hi Chandeep. I tried that already but it gave me the following error: > > ERROR 1039: > <file LeadSales.pig, line 19, column 27> In alias X, incompatible > types in NotEqual Operator left hand side:int right hand > side:chararray. > > The error makes sense cause the fields I have are INT type and hence > cannot be compared to a chararray. > > > Thanks for the prompt response though. > > > > On Feb 17, 2016 16:32, "Chandeep Singh" <c...@chandeep.com> wrote: > > Try adding != '' along with IS NOT NULL. >> >>> On Feb 18, 2016, at 12:26 AM, Parth Sawant <parth.sawan...@gmail.com> >> wrote: >>> >>> I'm trying to Filter some null fields in Pig using 'IS NOT NULL' . For >> some >>> reason the null data values persist. >>> For eg: the following filter on storing it's contents, contains null >> values >>> for ABC and PQR. >>> >>> X = FILTER D BY (ABC IS NOT NULL) AND (ABC==1) AND (PQR==1) AND (PQR IS >> NOT >>> NULL) ; >>> >>> >>> Can someone help with this? >>> >>> Thanks >>> >>> Parth S >> >>
