Carlos Balduz created PIG-4237:
----------------------------------

             Summary: Error when there is a bag inside an RDD
                 Key: PIG-4237
                 URL: https://issues.apache.org/jira/browse/PIG-4237
             Project: Pig
          Issue Type: Bug
          Components: spark
            Reporter: Carlos Balduz
            Priority: Critical


Bags cannot be sent to an RDD, as it produces a SelfSpillBag$MemoryLimits not 
Serializable exception. This results in an error for almost every operation 
performed after grouping tuples.

This error is fixed after making transient the protected MemoryLimit memLimit 
attribute inside org.apache.pig.data.SelfSpillBag, but I do not know the impact 
of this change.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to