[jira] [Commented] (YARN-2647) Add yarn queue CLI to get queue infos

2014-10-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14184870#comment-14184870 ] Sunil G commented on YARN-2647: --- testResourceTrackerOnHA is not caused by this fix, seems

[jira] [Commented] (YARN-2647) Add yarn queue CLI to get queue infos

2014-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14184892#comment-14184892 ] Wangda Tan commented on YARN-2647: -- Hi [~sunilg], Latest patch LGTM, +1. Thanks, Wangda

[jira] [Created] (YARN-2750) Allow StateMachine has callback when transition fail

2014-10-27 Thread Jeff Zhang (JIRA)
Jeff Zhang created YARN-2750: Summary: Allow StateMachine has callback when transition fail Key: YARN-2750 URL: https://issues.apache.org/jira/browse/YARN-2750 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-2750) Allow StateMachine has callback when transition fail

2014-10-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated YARN-2750: - Description: We have a situation that sometimes Transition may fail, but we don't want to handle the fail

[jira] [Updated] (YARN-2750) Allow StateMachine has callback when transition fail

2014-10-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated YARN-2750: - Affects Version/s: 2.5.1 Allow StateMachine has callback when transition fail

[jira] [Updated] (YARN-2750) Allow StateMachine has callback when transition fail

2014-10-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated YARN-2750: - Attachment: YARN-2750.patch Attach a patch for initial review. Allow StateMachine has callback when

[jira] [Commented] (YARN-2743) Yarn jobs via oozie fail with failed to renew token (secure) or digest mismatch (unsecure) errors when RM is being killed

2014-10-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185078#comment-14185078 ] Hudson commented on YARN-2743: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #725 (See

[jira] [Commented] (YARN-2734) If a sub-folder is encountered by log aggregator it results in invalid aggregated file

2014-10-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185077#comment-14185077 ] Hudson commented on YARN-2734: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #725 (See

[jira] [Commented] (YARN-2741) Windows: Node manager cannot serve up log files via the web user interface when yarn.nodemanager.log-dirs to any drive letter other than C: (or, the drive that nodemanag

2014-10-27 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185104#comment-14185104 ] Varun Vasudev commented on YARN-2741: - [~cwelch] we should add some sort of unit test

[jira] [Updated] (YARN-2750) Allow StateMachine has callback when transition fail

2014-10-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated YARN-2750: - Attachment: YARN-2750-2.patch Allow StateMachine has callback when transition fail

[jira] [Commented] (YARN-2734) If a sub-folder is encountered by log aggregator it results in invalid aggregated file

2014-10-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185167#comment-14185167 ] Hudson commented on YARN-2734: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1914 (See

[jira] [Commented] (YARN-2743) Yarn jobs via oozie fail with failed to renew token (secure) or digest mismatch (unsecure) errors when RM is being killed

2014-10-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185168#comment-14185168 ] Hudson commented on YARN-2743: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1914 (See

[jira] [Updated] (YARN-2678) Recommended improvements to Yarn Registry

2014-10-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2678: - Attachment: YARN-2678-006.patch Patch 006 # javadoc and javac warnings believed fixed # purged the

[jira] [Updated] (YARN-2683) registry config options: document and move to core-default

2014-10-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2683: - Summary: registry config options: document and move to core-default (was: document registry

[jira] [Commented] (YARN-2683) registry config options: document and move to core-default

2014-10-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185213#comment-14185213 ] Steve Loughran commented on YARN-2683: -- I've added one more action to this JIRA: move

[jira] [Commented] (YARN-2678) Recommended improvements to Yarn Registry

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185230#comment-14185230 ] Hadoop QA commented on YARN-2678: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2734) If a sub-folder is encountered by log aggregator it results in invalid aggregated file

2014-10-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185231#comment-14185231 ] Hudson commented on YARN-2734: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1939 (See

[jira] [Commented] (YARN-2743) Yarn jobs via oozie fail with failed to renew token (secure) or digest mismatch (unsecure) errors when RM is being killed

2014-10-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185232#comment-14185232 ] Hudson commented on YARN-2743: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1939 (See

[jira] [Updated] (YARN-2683) registry config options: document and move to core-default

2014-10-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2683: - Attachment: YARN-2683-003.patch Patch -003. The configuration document is available [[rendered on

[jira] [Updated] (YARN-2186) Node Manager uploader service for cache manager

2014-10-27 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2186: -- Attachment: YARN-2186-trunk-v4.patch Posted v4. Up to date with YARN-2183. To see the diffs on github,

[jira] [Commented] (YARN-2683) registry config options: document and move to core-default

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185356#comment-14185356 ] Hadoop QA commented on YARN-2683: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2186) Node Manager uploader service for cache manager

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185366#comment-14185366 ] Hadoop QA commented on YARN-2186: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2194) Add Cgroup support for RedHat 7

2014-10-27 Thread bc Wong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185368#comment-14185368 ] bc Wong commented on YARN-2194: --- container-executor.c * L1188: If initialize_user() fails, do

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2014-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185372#comment-14185372 ] Wangda Tan commented on YARN-2729: -- Hi [~Naganarasimha], For 1. I think what I meant is

[jira] [Commented] (YARN-2726) CapacityScheduler should explicitly log when an accessible label has no capacity

2014-10-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185449#comment-14185449 ] Xuan Gong commented on YARN-2726: - +1 lgtm. Will commit it. CapacityScheduler should

[jira] [Commented] (YARN-2744) Under some scenario, it is possible to end up with capacity scheduler configuration that uses labels that no longer exist

2014-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185458#comment-14185458 ] Wangda Tan commented on YARN-2744: -- As offline discussed with [~vinodkv], what this patch

[jira] [Commented] (YARN-2726) CapacityScheduler should explicitly log when an accessible label has no capacity

2014-10-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185462#comment-14185462 ] Xuan Gong commented on YARN-2726: - Committed to trunk, branch-2 and branch-2.6. Thanks

[jira] [Commented] (YARN-2726) CapacityScheduler should explicitly log when an accessible label has no capacity

2014-10-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185463#comment-14185463 ] Hudson commented on YARN-2726: -- FAILURE: Integrated in Hadoop-trunk-Commit #6354 (See

[jira] [Commented] (YARN-2726) CapacityScheduler should explicitly log when an accessible label has no capacity

2014-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185464#comment-14185464 ] Wangda Tan commented on YARN-2726: -- Thanks [~xgong]'s review and commit!

[jira] [Updated] (YARN-2744) Under some scenario, it is possible to end up with capacity scheduler configuration that uses labels that no longer exist

2014-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2744: - Priority: Critical (was: Major) Under some scenario, it is possible to end up with capacity scheduler

[jira] [Created] (YARN-2751) HdfsConstants#MEMORY_STORAGE_POLICY_ID and HdfsConstants#MEMORY_STORAGE_POLICY_ID are missing in branch-2

2014-10-27 Thread Jing Zhao (JIRA)
Jing Zhao created YARN-2751: --- Summary: HdfsConstants#MEMORY_STORAGE_POLICY_ID and HdfsConstants#MEMORY_STORAGE_POLICY_ID are missing in branch-2 Key: YARN-2751 URL: https://issues.apache.org/jira/browse/YARN-2751

[jira] [Commented] (YARN-2591) AHSWebServices should return FORBIDDEN(403) if the request user doesn't have access to the history data

2014-10-27 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185485#comment-14185485 ] Jian He commented on YARN-2591: --- looks good, +1 AHSWebServices should return FORBIDDEN(403)

[jira] [Commented] (YARN-2751) HdfsConstants#MEMORY_STORAGE_POLICY_ID and HdfsConstants#MEMORY_STORAGE_POLICY_ID are missing in branch-2

2014-10-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185490#comment-14185490 ] Jing Zhao commented on YARN-2751: - Oops, created in the wrong project...

[jira] [Commented] (YARN-2591) AHSWebServices should return FORBIDDEN(403) if the request user doesn't have access to the history data

2014-10-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185500#comment-14185500 ] Hudson commented on YARN-2591: -- FAILURE: Integrated in Hadoop-trunk-Commit #6355 (See

[jira] [Commented] (YARN-2704) Localization and log-aggregation will fail if hdfs delegation token expired after token-max-life-time

2014-10-27 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185534#comment-14185534 ] Jian He commented on YARN-2704: --- bq. if (this.token==null || this.applicationId==null ||

[jira] [Updated] (YARN-2704) Localization and log-aggregation will fail if hdfs delegation token expired after token-max-life-time

2014-10-27 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2704: -- Attachment: YARN-2704.4.patch Fixed previous comments Localization and log-aggregation will fail if hdfs

[jira] [Commented] (YARN-443) allow OS scheduling priority of NM to be different than the containers it launches

2014-10-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185542#comment-14185542 ] Xuan Gong commented on YARN-443: [~tgraves] I found that the function

[jira] [Commented] (YARN-2741) Windows: Node manager cannot serve up log files via the web user interface when yarn.nodemanager.log-dirs to any drive letter other than C: (or, the drive that nodemanag

2014-10-27 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185572#comment-14185572 ] Craig Welch commented on YARN-2741: --- Will do, making patch available so I can see the

[jira] [Commented] (YARN-443) allow OS scheduling priority of NM to be different than the containers it launches

2014-10-27 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185578#comment-14185578 ] Thomas Graves commented on YARN-443: Can you be more specific, what is different about

[jira] [Updated] (YARN-2571) RM to support YARN registry

2014-10-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2571: - Attachment: YARN-2571-006.patch Patch 006: upgrade use a URI in the api from a SHOULD to a MUST;

[jira] [Updated] (YARN-2571) RM to support YARN registry

2014-10-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2571: - Attachment: (was: YARN-2571-006.patch) RM to support YARN registry

[jira] [Updated] (YARN-2678) Recommended improvements to Yarn Registry

2014-10-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2678: - Attachment: YARN-2678-007.patch patch 007: upgrade use a URI in the api from a SHOULD to a MUST;

[jira] [Commented] (YARN-2741) Windows: Node manager cannot serve up log files via the web user interface when yarn.nodemanager.log-dirs to any drive letter other than C: (or, the drive that nodemanag

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185636#comment-14185636 ] Hadoop QA commented on YARN-2741: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2678) Recommended improvements to Yarn Registry

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185637#comment-14185637 ] Hadoop QA commented on YARN-2678: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-2752) TestContainerExecutor.testRunCommandNoPriority fails in branch-2

2014-10-27 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-2752: --- Summary: TestContainerExecutor.testRunCommandNoPriority fails in branch-2 Key: YARN-2752 URL: https://issues.apache.org/jira/browse/YARN-2752 Project: Hadoop YARN

[jira] [Updated] (YARN-2752) TestContainerExecutor.testRunCommandNoPriority fails in branch-2

2014-10-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2752: Description: TestContainerExecutor.testRunCommandNoPriority fails in branch-2. But it passed in trunk. The

[jira] [Updated] (YARN-2752) TestContainerExecutor.testRunCommandNoPriority fails in branch-2

2014-10-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2752: Attachment: YARN-2752.1-branch-2.patch TestContainerExecutor.testRunCommandNoPriority fails in branch-2

[jira] [Updated] (YARN-2669) FairScheduler: queueName shouldn't allow periods the allocation.xml

2014-10-27 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2669: -- Attachment: YARN-2669-3.patch Thanks for the comments, [~bcwalrus]. How about replace the . with _dot_?

[jira] [Updated] (YARN-2745) YARN new pluggable scheduler which does multi-resource packing

2014-10-27 Thread Robert Grandl (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Grandl updated YARN-2745: Attachment: (was: tetris_design_doc.docx) YARN new pluggable scheduler which does

[jira] [Commented] (YARN-2704) Localization and log-aggregation will fail if hdfs delegation token expired after token-max-life-time

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185686#comment-14185686 ] Hadoop QA commented on YARN-2704: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2683) registry config options: document and move to core-default

2014-10-27 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185730#comment-14185730 ] Gour Saha commented on YARN-2683: - Steve, It looks great, just one minor thing - Orig: It

[jira] [Commented] (YARN-2752) TestContainerExecutor.testRunCommandNoPriority fails in branch-2

2014-10-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185732#comment-14185732 ] Xuan Gong commented on YARN-2752: - Initially, The function ContainerExecutor.getRunCommand

[jira] [Commented] (YARN-2669) FairScheduler: queueName shouldn't allow periods the allocation.xml

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185813#comment-14185813 ] Hadoop QA commented on YARN-2669: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2010) If RM fails to recover an app, it can never transition to active again

2014-10-27 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185845#comment-14185845 ] Karthik Kambatla commented on YARN-2010: [~vinodkv], [~jlowe], [~jianhe] - will any

[jira] [Created] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread zhihai xu (JIRA)
zhihai xu created YARN-2753: --- Summary: potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager Key: YARN-2753 URL: https://issues.apache.org/jira/browse/YARN-2753 Project: Hadoop YARN

[jira] [Updated] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Attachment: YARN-2753.000.patch potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

[jira] [Updated] (YARN-2502) Changes in distributed shell to support specify labels

2014-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2502: - Attachment: YARN-2502-20141027-2.patch Changes in distributed shell to support specify labels

[jira] [Commented] (YARN-2010) If RM fails to recover an app, it can never transition to active again

2014-10-27 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185883#comment-14185883 ] Jian He commented on YARN-2010: --- sorry, was caught up with something. I'll review today.

[jira] [Commented] (YARN-2749) Some testcases from TestLogAggregationService fails in trunk

2014-10-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185924#comment-14185924 ] Xuan Gong commented on YARN-2749: - This is because of race condition and it is the testcase

[jira] [Commented] (YARN-2502) Changes in distributed shell to support specify labels

2014-10-27 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12677419/YARN-2502-20141027-2.patch against trunk revision 5b1dfe7. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears

[jira] [Commented] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185931#comment-14185931 ] Hadoop QA commented on YARN-2753: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-2755) NM fails to clean up usercache_DEL_timestamp dirs after YARN-661

2014-10-27 Thread Siqi Li (JIRA)
Siqi Li created YARN-2755: - Summary: NM fails to clean up usercache_DEL_timestamp dirs after YARN-661 Key: YARN-2755 URL: https://issues.apache.org/jira/browse/YARN-2755 Project: Hadoop YARN Issue

[jira] [Assigned] (YARN-2755) NM fails to clean up usercache_DEL_timestamp dirs after YARN-661

2014-10-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li reassigned YARN-2755: - Assignee: Siqi Li NM fails to clean up usercache_DEL_timestamp dirs after YARN-661

[jira] [Updated] (YARN-2755) NM fails to clean up usercache_DEL_timestamp dirs after YARN-661

2014-10-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2755: -- Description: When NM restarts frequently due to some reason, a large number of directories like these left in

[jira] [Commented] (YARN-2755) NM fails to clean up usercache_DEL_timestamp dirs after YARN-661

2014-10-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185948#comment-14185948 ] Siqi Li commented on YARN-2755: --- [~sjlee0] mentioned that NM's initialization is taking a

[jira] [Commented] (YARN-2704) Localization and log-aggregation will fail if hdfs delegation token expired after token-max-life-time

2014-10-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185954#comment-14185954 ] Vinod Kumar Vavilapalli commented on YARN-2704: --- +1, looks good. Checking

[jira] [Updated] (YARN-2704) Localization and log-aggregation will fail if hdfs delegation token expired after token-max-life-time

2014-10-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2704: -- Priority: Critical (was: Major) This is critical for long running services.

[jira] [Commented] (YARN-2704) Localization and log-aggregation will fail if hdfs delegation token expired after token-max-life-time

2014-10-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185963#comment-14185963 ] Hudson commented on YARN-2704: -- FAILURE: Integrated in Hadoop-trunk-Commit #6357 (See

[jira] [Commented] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185977#comment-14185977 ] Wangda Tan commented on YARN-2753: -- [~zxu], Nice finding! Thanks for the patch, looks good

[jira] [Updated] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2753: - Issue Type: Sub-task (was: Bug) Parent: YARN-2492 potential NPE in checkRemoveLabelsFromNode of

[jira] [Updated] (YARN-2755) NM fails to clean up usercache_DEL_timestamp dirs after YARN-661

2014-10-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2755: -- Attachment: YARN-2755.v1.patch NM fails to clean up usercache_DEL_timestamp dirs after YARN-661

[jira] [Updated] (YARN-2755) NM fails to clean up usercache_DEL_timestamp dirs after YARN-661

2014-10-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2755: -- Priority: Critical (was: Major) NM fails to clean up usercache_DEL_timestamp dirs after YARN-661

[jira] [Updated] (YARN-2754) addToCluserNodeLabels should be protected by writeLock in RMNodeLabelsManager.java.

2014-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2754: - Issue Type: Sub-task (was: Bug) Parent: YARN-2492 addToCluserNodeLabels should be protected by

[jira] [Commented] (YARN-2754) addToCluserNodeLabels should be protected by writeLock in RMNodeLabelsManager.java.

2014-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185982#comment-14185982 ] Wangda Tan commented on YARN-2754: -- Zhihai, Thanks reporting and the fix, Patch LGTM +1,

[jira] [Created] (YARN-2756) use static variable (Resources.none()) for not-running Node.resource in CommonNodeLabelsManager to save memory.

2014-10-27 Thread zhihai xu (JIRA)
zhihai xu created YARN-2756: --- Summary: use static variable (Resources.none()) for not-running Node.resource in CommonNodeLabelsManager to save memory. Key: YARN-2756 URL: https://issues.apache.org/jira/browse/YARN-2756

[jira] [Updated] (YARN-2756) use static variable (Resources.none()) for not-running Node.resource in CommonNodeLabelsManager to save memory.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2756: Description: use static variable (Resources.none()) for not-running Node.resource in CommonNodeLabelsManager

[jira] [Updated] (YARN-2756) use static variable (Resources.none()) for not-running Node.resource in CommonNodeLabelsManager to save memory.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2756: Attachment: YARN-2756.000.patch use static variable (Resources.none()) for not-running Node.resource in

[jira] [Updated] (YARN-2741) Windows: Node manager cannot serve up log files via the web user interface when yarn.nodemanager.log-dirs to any drive letter other than C: (or, the drive that nodemanager

2014-10-27 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2741: -- Attachment: YARN-2741.6.patch Added unit tests Windows: Node manager cannot serve up log files via the

[jira] [Commented] (YARN-2502) Changes in distributed shell to support specify labels

2014-10-27 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12677419/YARN-2502-20141027-2.patch against trunk revision a16d022. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears

[jira] [Updated] (YARN-2755) NM fails to clean up usercache_DEL_timestamp dirs after YARN-661

2014-10-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2755: -- Attachment: (was: YARN-2755.v1.patch) NM fails to clean up usercache_DEL_timestamp dirs after YARN-661

[jira] [Updated] (YARN-2755) NM fails to clean up usercache_DEL_timestamp dirs after YARN-661

2014-10-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2755: -- Attachment: YARN-2755.v1.patch NM fails to clean up usercache_DEL_timestamp dirs after YARN-661

[jira] [Updated] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Attachment: YARN-2753.001.patch potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

[jira] [Commented] (YARN-2755) NM fails to clean up usercache_DEL_timestamp dirs after YARN-661

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186048#comment-14186048 ] Hadoop QA commented on YARN-2755: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2754) addToCluserNodeLabels should be protected by writeLock in RMNodeLabelsManager.java.

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186049#comment-14186049 ] Hadoop QA commented on YARN-2754: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186047#comment-14186047 ] zhihai xu commented on YARN-2753: - [~leftnoteasy], thanks to review the patch, I remove

[jira] [Updated] (YARN-2749) Some testcases from TestLogAggregationService fails in trunk

2014-10-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2749: Attachment: YARN-2749.1.patch Some testcases from TestLogAggregationService fails in trunk

[jira] [Commented] (YARN-2755) NM fails to clean up usercache_DEL_timestamp dirs after YARN-661

2014-10-27 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186079#comment-14186079 ] Sangjin Lee commented on YARN-2755: --- @siqi, it would be good to elaborate on the nature

[jira] [Commented] (YARN-2741) Windows: Node manager cannot serve up log files via the web user interface when yarn.nodemanager.log-dirs to any drive letter other than C: (or, the drive that nodemanag

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186094#comment-14186094 ] Hadoop QA commented on YARN-2741: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2755) NM fails to clean up usercache_DEL_timestamp dirs after YARN-661

2014-10-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186105#comment-14186105 ] Siqi Li commented on YARN-2755: --- When NM starts up, it moves usercache to

[jira] [Created] (YARN-2757) potential NPE in checkNodeLabelExpression of SchedulerUtils for nodeLabels.

2014-10-27 Thread zhihai xu (JIRA)
zhihai xu created YARN-2757: --- Summary: potential NPE in checkNodeLabelExpression of SchedulerUtils for nodeLabels. Key: YARN-2757 URL: https://issues.apache.org/jira/browse/YARN-2757 Project: Hadoop YARN

[jira] [Updated] (YARN-2757) potential NPE in checkNodeLabelExpression of SchedulerUtils for nodeLabels.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2757: Issue Type: Bug (was: Improvement) potential NPE in checkNodeLabelExpression of SchedulerUtils for

[jira] [Commented] (YARN-2755) NM fails to clean up usercache_DEL_timestamp dirs after YARN-661

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186115#comment-14186115 ] Hadoop QA commented on YARN-2755: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2698) Move getClusterNodeLabels and getNodeToLabels to YARN CLI instead of RMAdminCLI

2014-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2698: - Target Version/s: 2.6.0 Move getClusterNodeLabels and getNodeToLabels to YARN CLI instead of RMAdminCLI

[jira] [Updated] (YARN-2698) Move getClusterNodeLabels and getNodeToLabels to YARN CLI instead of RMAdminCLI

2014-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2698: - Priority: Critical (was: Major) Move getClusterNodeLabels and getNodeToLabels to YARN CLI instead of

[jira] [Created] (YARN-2758) Update TestApplicationHistoryClientService to use the new generic history store

2014-10-27 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2758: - Summary: Update TestApplicationHistoryClientService to use the new generic history store Key: YARN-2758 URL: https://issues.apache.org/jira/browse/YARN-2758 Project:

[jira] [Commented] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186125#comment-14186125 ] Hadoop QA commented on YARN-2753: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

2014-10-27 Thread sidharta seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186126#comment-14186126 ] sidharta seethana commented on YARN-1964: - Hi Abin, I applied the patch to a

[jira] [Commented] (YARN-2749) Some testcases from TestLogAggregationService fails in trunk

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186139#comment-14186139 ] Hadoop QA commented on YARN-2749: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (YARN-2759) addToCluserNodeLabels should not change the value in labelCollections if the key already exists to avoid the Label.resource is reset.

2014-10-27 Thread zhihai xu (JIRA)
zhihai xu created YARN-2759: --- Summary: addToCluserNodeLabels should not change the value in labelCollections if the key already exists to avoid the Label.resource is reset. Key: YARN-2759 URL:

[jira] [Updated] (YARN-2759) addToCluserNodeLabels should not change the value in labelCollections if the key already exists to avoid the Label.resource is reset.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2759: Attachment: YARN-2759.000.patch addToCluserNodeLabels should not change the value in labelCollections if

  1   2   >