Thanks! That worked!

On Tue, Sep 18, 2012 at 6:58 AM, Alan Gates <[email protected]> wrote:

> The added foreach will not generate another MR job.
>
> Alan.
>
> On Sep 18, 2012, at 8:54 AM, Ruslan Al-Fakikh wrote:
>
> > Hey,
> >
> > You can try cleaning in a separate FOREACH. I don't think it'll
> > trigger another MR job, but you better check it.
> > Example:
> > resultCleaned = FOREACH result GENERATE
> >                                               name::group::fileldName AS
> fileldName;
> >
> > Ruslan
> >
> > On Tue, Sep 18, 2012 at 3:01 AM, Robert Yerex
> > <[email protected]> wrote:
> >> Probably an easy one but...
> >>
> >> After processing a file through a series of groupings, aggreagtions and
> >> projections using flatten I end up with long concatenated names for each
> >> field shown in this snippre t from the JsonStorage generated schema
> >>
> >>        {
> >>
> >> "name"
> >>
> :"enrollments_instructor_1::enrollments_student_3::enrollments_student_2::enrollments_student_1::enrollments_section::enrollments::term::term_id"
> >> ,
> >>
> >>            "type":55,
> >>
> >>            "description":"autogenerated from Pig Field Schema",
> >>
> >>            "schema":null
> >>
> >>        },
> >> How do I get rid of all the concatenated naming?
> >>
> >> --
> >> Robert Yerex
> >> Data Scientist
> >> Civitas Learning
> >> www.civitaslearning.com
> >>
> >>
> >>
> >>
> >> --
> >> Robert Yerex
> >> Data Scientist
> >> Civitas Learning
> >> www.civitaslearning.com
>
>


-- 
Robert Yerex
Data Scientist
Civitas Learning
www.civitaslearning.com

Reply via email to