[
https://issues.apache.org/jira/browse/PIG-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Praveen Rachabattuni updated PIG-4059:
--------------------------------------
Description:
Setting up your development environment:
1. Check out Pig Spark branch.
2. Build Pig by running "ant jar".
3. Configure these environmental variables:
export PIG_CLASSPATH=$PIG_HOME/build/ivy/lib/Pig/*:/path/to/hadoop/conf
export SPARK_MASTER=local
4. Run Pig with "-x spark" option.
was: There is lot of interest in adding Spark as a backend execution engine
for Pig.
> Pig on Spark
> ------------
>
> Key: PIG-4059
> URL: https://issues.apache.org/jira/browse/PIG-4059
> Project: Pig
> Issue Type: New Feature
> Reporter: Rohini Palaniswamy
> Assignee: Praveen Rachabattuni
> Labels: spork
> Attachments: Pig-on-Spark-Design-Doc.pdf
>
>
> Setting up your development environment:
> 1. Check out Pig Spark branch.
> 2. Build Pig by running "ant jar".
> 3. Configure these environmental variables:
> export PIG_CLASSPATH=$PIG_HOME/build/ivy/lib/Pig/*:/path/to/hadoop/conf
> export SPARK_MASTER=local
> 4. Run Pig with "-x spark" option.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)