[
https://issues.apache.org/jira/browse/PIG-18?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12579594#action_12579594
]
Olga Natkovich commented on PIG-18:
-----------------------------------
Our scenerion is that we have hod installed on a set of machines from which the
cluster can be accessed. However, some users choose to run from their own
machines via ssh tunnel that connects them one of the machines with HOD.
For most cases this is not that much different than running pig command via ssh
except that the would need to copy pig script over. The useful case is when the
input or output data is local to their machine - that saves them the need to
copy things back and force. However, in that case, there is a bug in ssh
library that we use - it sometimes hangs the system during large data transfers.
What you are suggesting sound like something that HOD would need to do since
pig does not have direct access to torque and maui.
My plan is to put ssh tunneling code back for now since we have some people
here using it. I will change create and remove temp file code to do it via
command that can run locally or remotely depending on the mode.
> Making Pig work with HOD 0.4 and hadoop 0.16
> --------------------------------------------
>
> Key: PIG-18
> URL: https://issues.apache.org/jira/browse/PIG-18
> Project: Pig
> Issue Type: Bug
> Components: impl
> Reporter: Olga Natkovich
> Assignee: Olga Natkovich
> Priority: Critical
> Attachments: hadoop16.jar, PIG-18.patch,
> PIG-18.patch-v2craigm-07032008, PIG-18.patch-v3craigm-10032008
>
>
> Pig needs to work with the soon to be released hadoop on demand (HOD) version.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
