Re: about how to implement ship in other mode like "spark"

2015-01-04 Thread Xuefu Zhang
You might want to consider SparkContext.addFile() for distributing the file at the client and SparkFiles.get() for retrieving the file at the execution node. --Xuefu On Fri, Jan 2, 2015 at 7:15 PM, Zhang, Liyun wrote: > Hi all, > I want to ask a question about "ship" in pig: > Ship with s

[jira] [Commented] (PIG-4364) remove unnessary MR plan code generated in SparkLauncher.java

2015-01-04 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14264164#comment-14264164 ] liyunzhang_intel commented on PIG-4364: --- currently we still need following code in Spa

[jira] [Resolved] (PIG-4364) remove unnessary MR plan code generated in SparkLauncher.java

2015-01-04 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel resolved PIG-4364. --- Resolution: Not a Problem > remove unnessary MR plan code generated in SparkLauncher.java >

[jira] Subscription: PIG patch available

2015-01-04 Thread jira
Issue Subscription Filter: PIG patch available (27 issues) Subscriber: pigdaily Key Summary PIG-4366Port local mode tests to Tez - part5 https://issues.apache.org/jira/browse/PIG-4366 PIG-4362Make ship work with spark https://issues.apache.org/jira/browse/P