I'm trying to Filter some null fields in Pig using 'IS NOT NULL' . For some reason the null data values persist. For eg: the following filter on storing it's contents, contains null values for ABC and PQR.
X = FILTER D BY (ABC IS NOT NULL) AND (ABC==1) AND (PQR==1) AND (PQR IS NOT NULL) ; Can someone help with this? Thanks Parth S