[
https://issues.apache.org/jira/browse/PIG-170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pi Song updated PIG-170:
------------------------
Attachment: compareMemUsage.gif
By profiling memory usage, there is no significant difference. My system might
be too small.
A gap between horizonal grid lines = 50MB
Input size = 540MB
ChildTask process Max Heap = 200MB (Only 1 process)
a1 = group (load 'file:/tmp/bigfile1') ALL
store a1 into '/tmp/out3' USING BinStorage() ;
> Memory manager spills bags in the wrong order
> ---------------------------------------------
>
> Key: PIG-170
> URL: https://issues.apache.org/jira/browse/PIG-170
> Project: Pig
> Issue Type: Bug
> Reporter: Olga Natkovich
> Assignee: Amir Youssefi
> Attachments: compareMemUsage.gif, PIG-170_0_20080327.patch
>
>
> For optimal performance, we want to spill the largest bags first. This is not
> what is happening right now and could be causing some of our memory issues.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
