You might want to consider SparkContext.addFile() for distributing the file
at the client and SparkFiles.get() for retrieving the file at the execution
node.
--Xuefu
On Fri, Jan 2, 2015 at 7:15 PM, Zhang, Liyun wrote:
> Hi all,
> I want to ask a question about "ship" in pig:
> Ship with s
[
https://issues.apache.org/jira/browse/PIG-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14264164#comment-14264164
]
liyunzhang_intel commented on PIG-4364:
---
currently we still need following code in Spa
[
https://issues.apache.org/jira/browse/PIG-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyunzhang_intel resolved PIG-4364.
---
Resolution: Not a Problem
> remove unnessary MR plan code generated in SparkLauncher.java
>
Issue Subscription
Filter: PIG patch available (27 issues)
Subscriber: pigdaily
Key Summary
PIG-4366Port local mode tests to Tez - part5
https://issues.apache.org/jira/browse/PIG-4366
PIG-4362Make ship work with spark
https://issues.apache.org/jira/browse/P