Hey,
You can try cleaning in a separate FOREACH. I don't think it'll
trigger another MR job, but you better check it.
Example:
resultCleaned = FOREACH result GENERATE
name::group::fileldName AS
fileldName;
Ruslan
On Tue, Sep 18, 2012 at 3:01 AM, Robert Yerex
<[email protected]> wrote:
> Probably an easy one but...
>
> After processing a file through a series of groupings, aggreagtions and
> projections using flatten I end up with long concatenated names for each
> field shown in this snippre t from the JsonStorage generated schema
>
> {
>
> "name"
> :"enrollments_instructor_1::enrollments_student_3::enrollments_student_2::enrollments_student_1::enrollments_section::enrollments::term::term_id"
> ,
>
> "type":55,
>
> "description":"autogenerated from Pig Field Schema",
>
> "schema":null
>
> },
> How do I get rid of all the concatenated naming?
>
> --
> Robert Yerex
> Data Scientist
> Civitas Learning
> www.civitaslearning.com
>
>
>
>
> --
> Robert Yerex
> Data Scientist
> Civitas Learning
> www.civitaslearning.com