Thanks! That worked! On Tue, Sep 18, 2012 at 6:58 AM, Alan Gates <[email protected]> wrote:
> The added foreach will not generate another MR job. > > Alan. > > On Sep 18, 2012, at 8:54 AM, Ruslan Al-Fakikh wrote: > > > Hey, > > > > You can try cleaning in a separate FOREACH. I don't think it'll > > trigger another MR job, but you better check it. > > Example: > > resultCleaned = FOREACH result GENERATE > > name::group::fileldName AS > fileldName; > > > > Ruslan > > > > On Tue, Sep 18, 2012 at 3:01 AM, Robert Yerex > > <[email protected]> wrote: > >> Probably an easy one but... > >> > >> After processing a file through a series of groupings, aggreagtions and > >> projections using flatten I end up with long concatenated names for each > >> field shown in this snippre t from the JsonStorage generated schema > >> > >> { > >> > >> "name" > >> > :"enrollments_instructor_1::enrollments_student_3::enrollments_student_2::enrollments_student_1::enrollments_section::enrollments::term::term_id" > >> , > >> > >> "type":55, > >> > >> "description":"autogenerated from Pig Field Schema", > >> > >> "schema":null > >> > >> }, > >> How do I get rid of all the concatenated naming? > >> > >> -- > >> Robert Yerex > >> Data Scientist > >> Civitas Learning > >> www.civitaslearning.com > >> > >> > >> > >> > >> -- > >> Robert Yerex > >> Data Scientist > >> Civitas Learning > >> www.civitaslearning.com > > -- Robert Yerex Data Scientist Civitas Learning www.civitaslearning.com
