[ https://issues.apache.org/jira/browse/PIG-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16111076#comment-16111076 ]
Adam Szita commented on PIG-5283: --------------------------------- I propose we make use of SparkPigSplit and write the conf along with the split as seen in: [^PIG-5283.0.patch] [~kellyzly], [~nkollar] let me know what you think > Configuration is not passed to SparkPigSplits on the backend > ------------------------------------------------------------ > > Key: PIG-5283 > URL: https://issues.apache.org/jira/browse/PIG-5283 > Project: Pig > Issue Type: Bug > Components: spark > Reporter: Adam Szita > Assignee: Adam Szita > Attachments: PIG-5283.0.patch > > > When a Hadoop ObjectWritable is created during a Spark job, the instantiated > PigSplit (wrapped into a SparkPigSplit) is given an empty Configuration > instance. > This happens > [here|https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/SerializableWritable.scala#L44] -- This message was sent by Atlassian JIRA (v6.4.14#64029)