PERFORMANCE: improve how data is stored between M-R jobs and between Map and 

                 Key: PIG-686
             Project: Pig
          Issue Type: Improvement
    Affects Versions: types_branch
            Reporter: Olga Natkovich
             Fix For: types_branch

Currently, there is quite a bit of overhead in how the data is serialized in 
both cases because a type information is stored with each field.

However, most of the time the data has known and consistent schema in which 
case, it is sufficient to store the schema once. 

This change could really decrease the ammount of intermediate data generated.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

Reply via email to