[
https://issues.apache.org/jira/browse/TEZ-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15314922#comment-15314922
]
Prasanth Jayachandran edited comment on TEZ-3290 at 6/3/16 10:03 PM:
---------------------------------------------------------------------
I don't really need to use ApplicationId if tez sets full task attempt id in
conf object. In LLAP input format, I am adding file system counters per task
attempt. For that I need unique identifier for task attempt ID. MRInput puts
many identifiers (relative index) for each components (attempt, task, vertex,
dag) separately. But it does not put the full task attempt id string.
For now I am constructing the full task attempt id myself using the existing
information from job conf. If MRInput sets the full task attempt id then I
don't have to rely on ApplicationId.
was (Author: prasanth_j):
I don't really need to ApplicationId if tez sets full task attempt id in conf
object. In LLAP input format, I am adding file system counters per task
attempt. For that I need unique identifier for task attempt ID. MRInput puts
many identifiers (relative index) for each components (attempt, task, vertex,
dag) separately. But it does not put the full task attempt id string.
For now I am constructing the full task attempt id myself using the existing
information from job conf. If MRInput sets the full task attempt id then I
don't have to rely on ApplicationId.
> Set full task attempt id string in configuration object
> -------------------------------------------------------
>
> Key: TEZ-3290
> URL: https://issues.apache.org/jira/browse/TEZ-3290
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.9.0, 0.8.4
> Reporter: Prasanth Jayachandran
> Assignee: Prasanth Jayachandran
>
> MRInput sets dag index, vertex index, task index, task attempt index and
> application id string in configuration object. Constructing full task attempt
> identifier (applicationId_dagIndex_vertexIndex_taskIndex_taskAttempIndex)
> from the individual pieces if error prone because of conversion from string
> to int conversions. Also YARN does not provide an API to construct
> ApplicationID object from string. It will be much easier if tez
> MRInputHelpers set the full taskAttemptID string in configuration object.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
