Hi Chandeep. I tried that already but it gave me the following error: ERROR 1039: <file LeadSales.pig, line 19, column 27> In alias X, incompatible types in NotEqual Operator left hand side:int right hand side:chararray.
The error makes sense cause the fields I have are INT type and hence cannot be compared to a chararray. Thanks for the prompt response though. On Feb 17, 2016 16:32, "Chandeep Singh" <c...@chandeep.com> wrote: Try adding != '' along with IS NOT NULL. > > > On Feb 18, 2016, at 12:26 AM, Parth Sawant <parth.sawan...@gmail.com> > wrote: > > > > I'm trying to Filter some null fields in Pig using 'IS NOT NULL' . For > some > > reason the null data values persist. > > For eg: the following filter on storing it's contents, contains null > values > > for ABC and PQR. > > > > X = FILTER D BY (ABC IS NOT NULL) AND (ABC==1) AND (PQR==1) AND (PQR IS > NOT > > NULL) ; > > > > > > Can someone help with this? > > > > Thanks > > > > Parth S > >
