[
https://issues.apache.org/jira/browse/PIG-44?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12549176
]
Olga Natkovich commented on PIG-44:
-----------------------------------
isn't 50000 too high? I am concerned that we can blow memory if we set it that
high.
> Problem with spilling BigBags
> -----------------------------
>
> Key: PIG-44
> URL: https://issues.apache.org/jira/browse/PIG-44
> Project: Pig
> Issue Type: Bug
> Reporter: Olga Natkovich
> Assignee: Olga Natkovich
> Attachments: spilling.patch
>
>
> Currently, once we spill the bag, if no additional memory becomes available,
> we would be spilling 1 record at a time because of the problem with the
> logic. Short term, we will make a change to spill 100 records at a time.
> Longer term, we need to try and drain the memory before doing so.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
