[jira] [Commented] (YARN-716) Make ApplicationID immutable

2013-05-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669030#comment-13669030 ] Hadoop QA commented on YARN-716: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-422) Add NM client library

2013-05-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669145#comment-13669145 ] Hudson commented on YARN-422: - Integrated in Hadoop-Yarn-trunk #224 (See

[jira] [Commented] (YARN-117) Enhance YARN service model

2013-05-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669173#comment-13669173 ] Hadoop QA commented on YARN-117: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-422) Add NM client library

2013-05-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669217#comment-13669217 ] Hudson commented on YARN-422: - Integrated in Hadoop-Hdfs-trunk #1414 (See

[jira] [Commented] (YARN-512) Log aggregation root directory check is more expensive than it needs to be

2013-05-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669227#comment-13669227 ] Jason Lowe commented on YARN-512: - +1, will commit shortly. Log

[jira] [Commented] (YARN-422) Add NM client library

2013-05-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669271#comment-13669271 ] Hudson commented on YARN-422: - Integrated in Hadoop-Mapreduce-trunk #1440 (See

[jira] [Commented] (YARN-512) Log aggregation root directory check is more expensive than it needs to be

2013-05-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669303#comment-13669303 ] Hudson commented on YARN-512: - Integrated in Hadoop-trunk-Commit #3798 (See

[jira] [Updated] (YARN-326) Add multi-resource scheduling to the fair scheduler

2013-05-29 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-326: Attachment: YARN-326-3.patch Add multi-resource scheduling to the fair scheduler

[jira] [Commented] (YARN-326) Add multi-resource scheduling to the fair scheduler

2013-05-29 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669403#comment-13669403 ] Sandy Ryza commented on YARN-326: - Uploading a new patch that implements DRF comparisons

[jira] [Updated] (YARN-656) In scheduler UI, including reserved memory in Memory Total can make it exceed cluster capacity.

2013-05-29 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-656: Attachment: YARN-656.patch In scheduler UI, including reserved memory in Memory Total can make it

[jira] [Commented] (YARN-326) Add multi-resource scheduling to the fair scheduler

2013-05-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669453#comment-13669453 ] Hadoop QA commented on YARN-326: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-656) In scheduler UI, including reserved memory in Memory Total can make it exceed cluster capacity.

2013-05-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669461#comment-13669461 ] Hadoop QA commented on YARN-656: {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-639) Make AM of Distributed Shell Use NMClient

2013-05-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-639: - Attachment: YARN-639.1.patch Now change AM of distributed shell to use NMClient, and update the tests.

[jira] [Commented] (YARN-639) Make AM of Distributed Shell Use NMClient

2013-05-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669514#comment-13669514 ] Hadoop QA commented on YARN-639: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-435) Make it easier to access cluster topology information in an AM

2013-05-29 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669570#comment-13669570 ] Omkar Vinit Joshi commented on YARN-435: After discussion with [~vinodkv]

[jira] [Commented] (YARN-512) Log aggregation root directory check is more expensive than it needs to be

2013-05-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669604#comment-13669604 ] Vinod Kumar Vavilapalli commented on YARN-512: -- I was going to comment on it.

[jira] [Updated] (YARN-684) ContainerManager.startContainer needs to only have ContainerTokenIdentifier instead of the whole Container

2013-05-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-684: - Attachment: YARN-684.20130529.txt Straight-forward patch to replace Container with

[jira] [Commented] (YARN-512) Log aggregation root directory check is more expensive than it needs to be

2013-05-29 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669650#comment-13669650 ] Sandy Ryza commented on YARN-512: - [~tucu00] and I talked about this when working on

[jira] [Updated] (YARN-717) Copy BuilderUtil methods into token-related records

2013-05-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-717: - Attachment: YARN-717.2.patch The new patch rebased on YARN-422. Change the place where its casted as

[jira] [Updated] (YARN-513) Create common proxy client for communicating with RM

2013-05-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-513: - Attachment: YARN-513.11.patch added missing file Create common proxy client for communicating

[jira] [Updated] (YARN-578) NodeManager should use SecureIOUtils for serving and aggregating logs

2013-05-29 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-578: --- Attachment: YARN-578-20130529.patch NodeManager should use SecureIOUtils for serving

[jira] [Updated] (YARN-326) Add multi-resource scheduling to the fair scheduler

2013-05-29 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-326: Attachment: YARN-326-4.patch Add multi-resource scheduling to the fair scheduler

[jira] [Assigned] (YARN-552) Expose resource metrics as part of YarnClusterMetrics

2013-05-29 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi reassigned YARN-552: -- Assignee: Omkar Vinit Joshi Expose resource metrics as part of YarnClusterMetrics

[jira] [Commented] (YARN-512) Log aggregation root directory check is more expensive than it needs to be

2013-05-29 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669849#comment-13669849 ] Alejandro Abdelnur commented on YARN-512: - If filesystem caching is enabled, which

[jira] [Commented] (YARN-512) Log aggregation root directory check is more expensive than it needs to be

2013-05-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669856#comment-13669856 ] Vinod Kumar Vavilapalli commented on YARN-512: -- If at the time of creating an

[jira] [Commented] (YARN-578) NodeManager should use SecureIOUtils for serving and aggregating logs

2013-05-29 Thread Vinod Kumar Vavilapalli (JIRA)
-20130520.patch, YARN-578-20130528.1.patch, YARN-578-20130528.patch, YARN-578-20130529.patch Log servlets for serving logs and the ShuffleService for serving intermediate outputs both should use SecureIOUtils for avoiding symlink attacks. -- This message is automatically generated by JIRA

[jira] [Commented] (YARN-512) Log aggregation root directory check is more expensive than it needs to be

2013-05-29 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669866#comment-13669866 ] Alejandro Abdelnur commented on YARN-512: - AFAIK the FileSystem caching does not

[jira] [Commented] (YARN-578) NodeManager should use SecureIOUtils for serving and aggregating logs

2013-05-29 Thread Vinod Kumar Vavilapalli (JIRA)
-20130520.branch-2.patch, YARN-578-20130520.patch, YARN-578-20130528.1.patch, YARN-578-20130528.patch, YARN-578-20130529.patch Log servlets for serving logs and the ShuffleService for serving intermediate outputs both should use SecureIOUtils for avoiding symlink attacks. -- This message

[jira] [Commented] (YARN-578) NodeManager should use SecureIOUtils for serving and aggregating logs

2013-05-29 Thread Omkar Vinit Joshi (JIRA)
.branch-2.patch, YARN-578-20130520.patch, YARN-578-20130528.1.patch, YARN-578-20130528.patch, YARN-578-20130529.patch Log servlets for serving logs and the ShuffleService for serving intermediate outputs both should use SecureIOUtils for avoiding symlink attacks. -- This message

[jira] [Updated] (YARN-638) Restore RMDelegationTokens after RM Restart

2013-05-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-638: - Attachment: YARN-638.15.patch The new patch adds sleep within the tight loop and removes hadoop-common changes

[jira] [Commented] (YARN-638) Restore RMDelegationTokens after RM Restart

2013-05-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669959#comment-13669959 ] Hadoop QA commented on YARN-638: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-719) Move RMIdentifier from Container to ContainerTokenIdentifier

2013-05-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669974#comment-13669974 ] Siddharth Seth commented on YARN-719: - +1. The patch looks good. Needs to be rebased

[jira] [Commented] (YARN-638) Restore RMDelegationTokens after RM Restart

2013-05-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669975#comment-13669975 ] Vinod Kumar Vavilapalli commented on YARN-638: -- Perfect, looks good. +1. Will

[jira] [Created] (YARN-730) NMClientAsync needs to remove completed container

2013-05-29 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-730: Summary: NMClientAsync needs to remove completed container Key: YARN-730 URL: https://issues.apache.org/jira/browse/YARN-730 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-730) NMClientAsync needs to remove completed container

2013-05-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-730: - Attachment: YARN-730.1.patch If the container is failed or done, it should be removed from the

[jira] [Commented] (YARN-719) Move RMIdentifier from Container to ContainerTokenIdentifier

2013-05-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1367#comment-1367 ] Hadoop QA commented on YARN-719: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-638) Restore RMDelegationTokens after RM Restart

2013-05-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13670037#comment-13670037 ] Hudson commented on YARN-638: - Integrated in Hadoop-trunk-Commit #3808 (See

[jira] [Commented] (YARN-719) Move RMIdentifier from Container to ContainerTokenIdentifier

2013-05-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13670057#comment-13670057 ] Siddharth Seth commented on YARN-719: - Committing this. Thanks Vinod.