-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11718/
-----------------------------------------------------------
(Updated Nov. 11, 2014, 9:32 p.m.)
Review request for pig.
Changes
-------
Rebased to trunk. Also added a new counter called "CombinedInputSplits" to
track the # of combined input splits per task.
Bugs: PIG-3346
https://issues.apache.org/jira/browse/PIG-3346
Repository: pig-git
Description (updated)
-------
Adds a new property pig.maxCombinedSplitNum. Pig won't combine more splits than
the configured limit. By default, it is set to Long.MAX_VALUE.
Diffs (updated)
-----
src/docs/src/documentation/content/xdocs/perf.xml 32f0231
src/org/apache/pig/PigConfiguration.java d52518b
src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java
c74aabe
src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java
74c3ad5
src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigInputFormat.java
7072485
src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigRecordReader.java
1004df6
src/org/apache/pig/backend/hadoop/executionengine/util/MapRedUtil.java
66c049f
src/org/apache/pig/tools/pigstats/PigStatsUtil.java fb8d2a9
test/org/apache/pig/test/TestSplitCombine.java ce4f346
test/org/apache/pig/test/TestSplitIndex.java 4bfdeb4
Diff: https://reviews.apache.org/r/11718/diff/
Testing
-------
All unit tests pass.
A new unit test case is added for the new property.
Thanks,
Cheolsoo Park
