[ 
https://issues.apache.org/jira/browse/PIG-4173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14160284#comment-14160284
 ] 

Ángel Álvarez commented on PIG-4173:
------------------------------------

The "unread block data" error mentioned earlier is fixed by adding the 
following environment variable:

export SPARK_PIG_JAR=$PIG_HOME/pig-0.14.0-SNAPSHOT-core-h2.jar


> Move to Spark 1.x
> -----------------
>
>                 Key: PIG-4173
>                 URL: https://issues.apache.org/jira/browse/PIG-4173
>             Project: Pig
>          Issue Type: Sub-task
>          Components: spark
>            Reporter: bc Wong
>            Assignee: Richard Ding
>         Attachments: PIG-4173.patch, PIG-4173_2.patch, PIG-4173_3.patch, 
> PIG-4174_4.patch, PIG-4174_5.patch, TEST-org.apache.pig.spark.TestSpark.txt
>
>
> The Spark branch is using Spark 0.9: 
> https://github.com/apache/pig/blob/spark/ivy.xml#L438. We should probably 
> switch to Spark 1.x asap, due to Spark interface changes since 1.0.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to