Cheolsoo Park created PIG-3346:
----------------------------------
Summary: New property that controls the number of combined splits
Key: PIG-3346
URL: https://issues.apache.org/jira/browse/PIG-3346
Project: Pig
Issue Type: Improvement
Components: impl
Reporter: Cheolsoo Park
Assignee: Cheolsoo Park
Fix For: 0.12
Currently, the size of combined splits can be configured by the
{{pig.maxCombinedSplitSize}} property.
Although this works fine most of time, it can lead to a undesired situation
where a single mapper ends up loading a lot of combined splits. Particularly,
this is bad if Pig uploads them from S3.
So it will be useful if the max number of combined splits can be configured via
a property something like {{pig.maxCombinedSplitNum}}.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
