[
https://issues.apache.org/jira/browse/HADOOP-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615893#action_12615893
]
Hemanth Yamijala commented on HADOOP-3808:
------------------------------------------
The attached patch makes the following changes:
- Modified signature of updateWorkerInfo in nodePool.py as follows - including
the jobId, which should already have been there, and a list of keys - which
decides the order in which they are written to the notes attribute:
{code}
def updateWorkerInfo(self, workerInfoMap, jobId, keys)
{code}
- Modified implementation of the updateWorkerInfo in torque.py to use the new
signature.
- In hadoop.py, calling the method with the RPC port.
> [HOD] Include job tracker RPC in notes attribute after job submission
> ---------------------------------------------------------------------
>
> Key: HADOOP-3808
> URL: https://issues.apache.org/jira/browse/HADOOP-3808
> Project: Hadoop Core
> Issue Type: Improvement
> Affects Versions: 0.18.0
> Reporter: Hemanth Yamijala
> Assignee: Hemanth Yamijala
> Attachments: HADOOP-3808.patch
>
>
> Currently, after a job is submitted, HOD records the Jobtracker URL and the
> NameNode URL in the 'notes' attribute of the Torque resource manager. This
> helps in building centralized administration tools that need to get a full
> picture of all allocated clusters etc. Including the Jobtracker RPC port in
> this attribute would be useful to build such similar tools. One of them is an
> idle job tracker that can be centrally run to clear up any clusters that
> aren't automatically cleaned up due to some faulty nodes in the cluster or
> resource manager problems.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
