In that case, maybe it's the data, and what you think is null is actually
'\n' ?

-D

On Sun, May 16, 2010 at 4:07 PM, Syed Wasti <[email protected]> wrote:

> Doing absolutely the same thing and I am using pig 6 too.
> Tried with the fake data on both local and mapreduce modes, works fine.
> But on my script against actual data in mapreduce mode, it fails to do the
> same thing, places \N instead of U.
>
> grunt> rel1 = LOAD '/user/swasti/data' USING PigStorage('\t') as (num);
> grunt> dump rel1;
> (1)
> (2)
> (3)
> ()
> (5)
> grunt> find_null = FOREACH rel1 GENERATE (num is null?'U':num);
> grunt> dump find_null;
> (1)
> (2)
> (3)
> (U)
> (5)
>
>
> On 5/16/10 2:23 PM, "Dmitriy Ryaboy" <[email protected]> wrote:
>
> > So what I am saying is, check that you are not inserting some weird
> > non-ascii quotes in your actual script.
> > I just ran this on Pig 6, it worked:
> >
> > grunt> data = load 'tmp/nulltest' using PigStorage() as (num);
> > grunt> dump data;
> > (1)
> > (2)
> > ()
> > (3)
> > grunt> find_nulls = foreach data generate ( num is null ? 'U' : num );
> > grunt> dump find_nulls;
> > (1)
> > (2)
> > (U)
> > (3)
> >
> > I double-checked just in case, and it works in both local and mapreduce
> > modes.
> >
> > -Dmitriy
> >
> > On Sun, May 16, 2010 at 1:49 PM, Syed Wasti <[email protected]> wrote:
> >
> >> Hmm not sure why, I used quotes in this mail, let me rewrite,
> >> SQL(U is within single quotes): NVL(city,U) city
> >> Pig(U is within single quotes): (city is null?U:city) AS city
> >>
> >>
> >>
> >> On 5/16/10 1:36 PM, "Dmitriy Ryaboy" <[email protected]> wrote:
> >>
> >>> Syed,
> >>> The samples you pasted include all kinds of extraneous characters. Are
> >> you
> >>> sure your script is properly encoded?
> >>>
> >>>
> >>> On Sun, May 16, 2010 at 1:16 PM, Syed Wasti <[email protected]>
> wrote:
> >>>
> >>>> I am trying the SQL ³NVL(city, ŒU¹) city² in pig I am using the
> bincond
> >>>> operator, ³(city is null?'U': city) AS city², which is of chararray
> >> type,
> >>>> the result file shows Œ\N¹ instead of U.  Any ideas ?
> >>>>
> >>
> >>
> >>
>
>
>

Reply via email to