[
https://issues.apache.org/jira/browse/TEZ-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083173#comment-14083173
]
Daniel Dai commented on TEZ-1343:
---------------------------------
Tried Pig local tez mode, see stack:
org.apache.hadoop.service.ServiceStateException: java.io.FileNotFoundException:
/tmp/temp1006601151/.tez/application_1406934439610_0001/tez-dag.pb (No such
file or directory)
at
org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:204)
at org.apache.tez.dag.app.DAGAppMaster$5.run(DAGAppMaster.java:1901)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:394)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
at
org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:1897)
at org.apache.tez.client.LocalClient$1.run(LocalClient.java:264)
at java.lang.Thread.run(Thread.java:695)
Caused by: java.io.FileNotFoundException:
/tmp/temp1006601151/.tez/application_1406934439610_0001/tez-dag.pb (No such
file or directory)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(FileInputStream.java:120)
at java.io.FileInputStream.<init>(FileInputStream.java:79)
at org.apache.tez.dag.app.DAGAppMaster.startDAG(DAGAppMaster.java:1773)
at
org.apache.tez.dag.app.DAGAppMaster.serviceStart(DAGAppMaster.java:1556)
at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> Bypass the Fetcher and read directly from the local filesystem if source
> vertex ran on the same host
> ----------------------------------------------------------------------------------------------------
>
> Key: TEZ-1343
> URL: https://issues.apache.org/jira/browse/TEZ-1343
> Project: Apache Tez
> Issue Type: Task
> Affects Versions: 0.4.1
> Reporter: Prakash Ramachandran
> Assignee: Prakash Ramachandran
> Attachments: TEZ-1343.WIP.1.patch, TEZ-1343.WIP.2.patch
>
>
> In the case of the source and current vertex are on the same host bypass the
> Fetcher and read it directly from the local filesystem
--
This message was sent by Atlassian JIRA
(v6.2#6252)
