[
https://issues.apache.org/jira/browse/PIG-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dmitriy V. Ryaboy updated PIG-2888:
-----------------------------------
Attachment: PIG-2888.final.patch
Attaching final patch, committing under Julien's +1.
Three changes added:
1) Missed a test class earlier which needed the static string moved to
PigConfiguration. Done now.
2) a slight change to build.xml to ensure junit3 comes before junit4 in the
test classpath. Otherwise the build occasionally failed to compile, depending
on environment.
3) An unrelated fix to TestPOCast, which was failing and this preventing me
from passing test-commit.
> Improve performance of POPartialAgg
> -----------------------------------
>
> Key: PIG-2888
> URL: https://issues.apache.org/jira/browse/PIG-2888
> Project: Pig
> Issue Type: Improvement
> Reporter: Dmitriy V. Ryaboy
> Assignee: Dmitriy V. Ryaboy
> Attachments: partialagg_patch_1.patch, partialagg_patch_2.patch,
> partialagg_patch_3.patch, partialagg_patch_4.patch, partialagg_patch_5.patch,
> partialagg_patch_6.patch, PIG-2888.final.patch
>
>
> During performance testing, we found that POPartialAgg can cause performance
> degradation for Pig jobs when the Algebraic UDFs it's being applied to aren't
> well suited to the operator's assumptions. Changing the implementation to a
> more flexible hash-based model can provide significant performance
> improvements.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
