[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2014-12-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239090#comment-14239090 ] Karthik Kambatla commented on YARN-2618: The design doc talks about addressing this

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2014-12-08 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239089#comment-14239089 ] Varun Vasudev commented on YARN-2618: - Thanks for the reply! I'll follow up on the pare

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2014-12-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239086#comment-14239086 ] Karthik Kambatla commented on YARN-2618: In the context of this JIRA, vdisks is alw

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2014-12-08 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239083#comment-14239083 ] Varun Vasudev commented on YARN-2618: - [~kasha], [~ywskycn] - question on "vdisks". Wha

[jira] [Updated] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-2910: Attachment: YARN-2910.8.patch cleanup of spurious includes which should not be there

[jira] [Updated] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-2910: Attachment: YARN-2910.7.patch One final update to shorten the time we keep the lock a

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239059#comment-14239059 ] Karthik Kambatla commented on YARN-2910: mvn eclipse:eclipse passes for me locally

[jira] [Commented] (YARN-2762) RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM

2014-12-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239052#comment-14239052 ] Wangda Tan commented on YARN-2762: -- bq. I believe these findbug errors are ocuring due to

[jira] [Commented] (YARN-2762) RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM

2014-12-08 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239051#comment-14239051 ] Rohith commented on YARN-2762: -- I believe these findbug errors are ocuring due to either chang

[jira] [Commented] (YARN-2931) PublicLocalizer may fail until directory is initialized by LocalizeRunner

2014-12-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239047#comment-14239047 ] Hudson commented on YARN-2931: -- FAILURE: Integrated in Hadoop-trunk-Commit #6674 (See [https:

[jira] [Updated] (YARN-2931) PublicLocalizer may fail until directory is initialized by LocalizeRunner

2014-12-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2931: --- Summary: PublicLocalizer may fail until directory is initialized by LocalizeRunner (was: Publi

[jira] [Commented] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239032#comment-14239032 ] Karthik Kambatla commented on YARN-2931: +1 > PublicLocalizer may fail with FileNo

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2014-12-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239031#comment-14239031 ] Karthik Kambatla commented on YARN-2618: Thanks Wei. Comments: # I think we should

[jira] [Commented] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 8

2014-12-08 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239029#comment-14239029 ] Rohith commented on YARN-2930: -- I too think the randonmess is caused because of default file b

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239009#comment-14239009 ] Hadoop QA commented on YARN-2910: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239007#comment-14239007 ] Hadoop QA commented on YARN-2910: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 8

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238991#comment-14238991 ] Hadoop QA commented on YARN-2930: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-2910: Attachment: YARN-2910.6.patch updated patch with try finally clauses > FSLeafQueue c

[jira] [Commented] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238976#comment-14238976 ] Hadoop QA commented on YARN-2931: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2837) Timeline server needs to recover the timeline DT when restarting

2014-12-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238966#comment-14238966 ] Zhijie Shen commented on YARN-2837: --- The findbug warnings seem not to be related and vali

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238953#comment-14238953 ] Karthik Kambatla commented on YARN-2910: For lock-unlock, we follow the following c

[jira] [Updated] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-2931: Attachment: YARN-2931.005.patch Fixed the dead store findbugs > PublicLocalizer may fail with FileNo

[jira] [Updated] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-2910: Attachment: YARN-2910.5.patch OK, a complete new approach. The other approaches did n

[jira] [Commented] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238944#comment-14238944 ] Hadoop QA commented on YARN-2931: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238941#comment-14238941 ] Hadoop QA commented on YARN-2931: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238919#comment-14238919 ] Karthik Kambatla commented on YARN-2931: +1, pending Jenkins. > PublicLocalizer m

[jira] [Updated] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2931: --- Priority: Critical (was: Major) > PublicLocalizer may fail with FileNotFoundException until di

[jira] [Updated] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-2931: Attachment: YARN-2931.004.patch > PublicLocalizer may fail with FileNotFoundException until directory

[jira] [Commented] (YARN-2917) Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hook

2014-12-08 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238905#comment-14238905 ] Rohith commented on YARN-2917: -- Hi [~kasha], [~jianhe], [~vinodkv] Kindly review the analysis

[jira] [Commented] (YARN-2762) RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM

2014-12-08 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238902#comment-14238902 ] Rohith commented on YARN-2762: -- For all the syserr and sysout , findbug warning has been gener

[jira] [Updated] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-2931: Attachment: YARN-2931.003.patch Addressed comments and made test more robust to verifying the fix >

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238884#comment-14238884 ] Karthik Kambatla commented on YARN-2910: Looking around, we don't need the synchron

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238838#comment-14238838 ] Karthik Kambatla commented on YARN-2910: Here is the deadlock Wilfred was mentionin

[jira] [Updated] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 8

2014-12-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2930: - Attachment: YARN-2930.1.patch > TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails again

[jira] [Commented] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 8

2014-12-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238818#comment-14238818 ] Wangda Tan commented on YARN-2930: -- [~rohithsharma], I've looked into this, found the root

[jira] [Assigned] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 8

2014-12-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-2930: Assignee: Wangda Tan (was: Rohith) > TestRMRestart#testRMRestartRecoveringNodeLabelManager sometime

[jira] [Commented] (YARN-2920) CapacityScheduler should be notified when labels on nodes changed

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238784#comment-14238784 ] Hadoop QA commented on YARN-2920: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238770#comment-14238770 ] Hadoop QA commented on YARN-2931: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2837) Timeline server needs to recover the timeline DT when restarting

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238763#comment-14238763 ] Hadoop QA commented on YARN-2837: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2014-12-08 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238753#comment-14238753 ] Wei Yan commented on YARN-2618: --- Thanks for pointing out, [~leftnoteasy]. I'll check that and

[jira] [Created] (YARN-2933) Capacity Scheduler preemption policy should only consider capacity without labels temporarily

2014-12-08 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-2933: Summary: Capacity Scheduler preemption policy should only consider capacity without labels temporarily Key: YARN-2933 URL: https://issues.apache.org/jira/browse/YARN-2933 Pro

[jira] [Commented] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread bc Wong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238734#comment-14238734 ] bc Wong commented on YARN-2931: --- Thanks for the fix! Some nits. ResourceLocalizationService.j

[jira] [Commented] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238725#comment-14238725 ] Anubhav Dhoot commented on YARN-2931: - Findbugs donot seem related to the patch. Upload

[jira] [Updated] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-2931: Attachment: YARN-2931.002.patch > PublicLocalizer may fail with FileNotFoundException until directory

[jira] [Updated] (YARN-2837) Timeline server needs to recover the timeline DT when restarting

2014-12-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2837: -- Attachment: YARN-2837.5.patch > Timeline server needs to recover the timeline DT when restarting > --

[jira] [Updated] (YARN-2837) Timeline server needs to recover the timeline DT when restarting

2014-12-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2837: -- Attachment: (was: YARN-2837.5.patch) > Timeline server needs to recover the timeline DT when restarti

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2014-12-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238704#comment-14238704 ] Wangda Tan commented on YARN-2618: -- [~ywskycn], Capacity Scheduler already support multi-d

[jira] [Commented] (YARN-2837) Timeline server needs to recover the timeline DT when restarting

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238684#comment-14238684 ] Hadoop QA commented on YARN-2837: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238683#comment-14238683 ] Hadoop QA commented on YARN-2931: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2920) CapacityScheduler should be notified when labels on nodes changed

2014-12-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2920: - Attachment: YARN-2920.2.patch Updated patch, dropped some unnecessary refactoring code which will cause de

[jira] [Commented] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238675#comment-14238675 ] Hadoop QA commented on YARN-2900: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2837) Timeline server needs to recover the timeline DT when restarting

2014-12-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2837: -- Attachment: YARN-2837.5.patch Do two more things in the new patch: 1. Correct the logic of storing versi

[jira] [Commented] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2014-12-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238619#comment-14238619 ] Zhijie Shen commented on YARN-2900: --- bq. I am not sure why the timelineserver throws som

[jira] [Updated] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2014-12-08 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated YARN-2900: Attachment: YARN-2900.patch Refining patch. Missed to remove unused import > Application (Attempt and Contai

[jira] [Updated] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2014-12-08 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated YARN-2900: Attachment: YARN-2900.patch Attaching the patch that addresses the the NFE and indenting. I'll wait for your

[jira] [Commented] (YARN-2932) Add entry for preemption setting to queue status screen and startup/refresh logging

2014-12-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238582#comment-14238582 ] Wangda Tan commented on YARN-2932: -- Thanks for raising this up [~eepayne], it is a good ad

[jira] [Updated] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-2931: Attachment: YARN-2931.002.patch Fixed javac warnings > PublicLocalizer may fail with FileNotFoundExc

[jira] [Assigned] (YARN-2932) Add entry for preemption setting to queue status screen and startup/refresh logging

2014-12-08 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-2932: Assignee: Eric Payne > Add entry for preemption setting to queue status screen and startup/refresh

[jira] [Created] (YARN-2932) Add entry for preemption setting to queue status screen and startup/refresh logging

2014-12-08 Thread Eric Payne (JIRA)
Eric Payne created YARN-2932: Summary: Add entry for preemption setting to queue status screen and startup/refresh logging Key: YARN-2932 URL: https://issues.apache.org/jira/browse/YARN-2932 Project: Hado

[jira] [Commented] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238529#comment-14238529 ] Hadoop QA commented on YARN-2931: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2892) Unable to get AMRMToken in unmanaged AM when using a secure cluster

2014-12-08 Thread Sevada Abraamyan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238520#comment-14238520 ] Sevada Abraamyan commented on YARN-2892: On second thought I think [~djp] was refer

[jira] [Commented] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238480#comment-14238480 ] Karthik Kambatla commented on YARN-2931: Initially in the description, from Anubhav

[jira] [Updated] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2931: --- Description: When the data directory is cleaned up and NM is started with existing recovery st

[jira] [Updated] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-2931: Attachment: YARN-2931.001.patch Let PublicLocalizer also initialize the local directories similar to

[jira] [Assigned] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot reassigned YARN-2931: --- Assignee: Anubhav Dhoot > PublicLocalizer may fail with FileNotFoundException until directory

[jira] [Updated] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-2931: Description: When the data directory is cleaned up and NM is started with existing recovery state, b

[jira] [Created] (YARN-2931) PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner

2014-12-08 Thread Anubhav Dhoot (JIRA)
Anubhav Dhoot created YARN-2931: --- Summary: PublicLocalizer may fail with FileNotFoundException until directory gets initialized by LocalizeRunner Key: YARN-2931 URL: https://issues.apache.org/jira/browse/YARN-2931

[jira] [Commented] (YARN-2925) Internal fields in LeafQueue access should be protected when accessed from FiCaSchedulerApp to calculate Headroom

2014-12-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238365#comment-14238365 ] Wangda Tan commented on YARN-2925: -- [~cwelch], Thanks for your comments, your suggestion m

[jira] [Updated] (YARN-2571) RM to support YARN registry

2014-12-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2571: - Attachment: YARN-2571-009.patch patch -009 in sync with trunk > RM to support YARN registry > ---

[jira] [Commented] (YARN-2762) RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM

2014-12-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238357#comment-14238357 ] Wangda Tan commented on YARN-2762: -- Looks good, thanks for update, test failure shouldn't

[jira] [Commented] (YARN-2284) Find missing config options in YarnConfiguration and yarn-default.xml

2014-12-08 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238356#comment-14238356 ] Ray Chiang commented on YARN-2284: -- RE: Findbugs. I don't see the any of the findbugs war

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238336#comment-14238336 ] Hadoop QA commented on YARN-2495: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2284) Find missing config options in YarnConfiguration and yarn-default.xml

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238332#comment-14238332 ] Hadoop QA commented on YARN-2284: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-436) Document how to use DistributedShell yarn application

2014-12-08 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-436: - Assignee: (was: Hitesh Shah) > Document how to use DistributedShell yarn application > -

[jira] [Updated] (YARN-510) Writing Yarn Applications documentation should be changed to signify use of of fully qualified paths when localizing resources

2014-12-08 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-510: - Assignee: (was: Hitesh Shah) > Writing Yarn Applications documentation should be changed to signify use

[jira] [Resolved] (YARN-405) Add command start-up time to environment of a container to track launch costs

2014-12-08 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved YARN-405. -- Resolution: Not a Problem > Add command start-up time to environment of a container to track launch costs

[jira] [Commented] (YARN-2892) Unable to get AMRMToken in unmanaged AM when using a secure cluster

2014-12-08 Thread Sevada Abraamyan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238307#comment-14238307 ] Sevada Abraamyan commented on YARN-2892: I don't see this either. However, one thin

[jira] [Commented] (YARN-2683) registry config options: document and move to core-default

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238303#comment-14238303 ] Hadoop QA commented on YARN-2683: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2618) Avoid over-allocation of disk resources

2014-12-08 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2618: -- Attachment: YARN-2618-2.patch Thanks, [~kasha]. Update a new patch to fix the comments. The existing patch works

[jira] [Commented] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2014-12-08 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238255#comment-14238255 ] Mit Desai commented on YARN-2900: - [~zjshen], from the changes that the patch makes, only t

[jira] [Commented] (YARN-2762) RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238237#comment-14238237 ] Hadoop QA commented on YARN-2762: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2927) InMemorySCMStore properties are inconsistent

2014-12-08 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238211#comment-14238211 ] Chris Trezzo commented on YARN-2927: Thanks [~rchiang] for the fix! > InMemorySCMStore

[jira] [Updated] (YARN-2284) Find missing config options in YarnConfiguration and yarn-default.xml

2014-12-08 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-2284: - Attachment: YARN-2284-09.patch Updated for latest Configuration variables. > Find missing config options i

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-08 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238184#comment-14238184 ] Ray Chiang commented on YARN-2910: -- Never mind, I misread the earlier JIRA history. I mus

[jira] [Commented] (YARN-2284) Find missing config options in YarnConfiguration and yarn-default.xml

2014-12-08 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238183#comment-14238183 ] Ray Chiang commented on YARN-2284: -- Initial version of this fix needs all Configuration pr

[jira] [Commented] (YARN-2762) RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM

2014-12-08 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238176#comment-14238176 ] Rohith commented on YARN-2762: -- Updated the patch fixing review comment. Kindly review updated

[jira] [Updated] (YARN-2762) RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM

2014-12-08 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-2762: - Attachment: YARN-2762.6.patch > RMAdminCLI node-labels-related args should be trimmed and checked before > sending

[jira] [Commented] (YARN-2928) Application Timeline Server (ATS) next gen: phase 1

2014-12-08 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238165#comment-14238165 ] Sangjin Lee commented on YARN-2928: --- Thanks [~vinodkv]! I'll post the design doc pretty s

[jira] [Commented] (YARN-2517) Implement TimelineClientAsync

2014-12-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238158#comment-14238158 ] Zhijie Shen commented on YARN-2517: --- [~ozawa], we may hay to hang on a bit about the asyn

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2014-12-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238157#comment-14238157 ] Wangda Tan commented on YARN-2495: -- [~Naganarasimha], I meant you can leave it empty in th

[jira] [Commented] (YARN-2925) Internal fields in LeafQueue access should be protected when accessed from FiCaSchedulerApp to calculate Headroom

2014-12-08 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238155#comment-14238155 ] Craig Welch commented on YARN-2925: --- Hmm, there might be an even simpler approach - if we

[jira] [Updated] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2014-12-08 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2495: Attachment: YARN-2495.20141208-1.patch hi [~wangda], I have set the default implementation cl

[jira] [Updated] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-08 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-2910: - Assignee: Wilfred Spiegelenburg (was: Ray Chiang) > FSLeafQueue can throw ConcurrentModificationException

[jira] [Commented] (YARN-2637) maximum-am-resource-percent could be violated when resource of AM is > minimumAllocation

2014-12-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238139#comment-14238139 ] Junping Du commented on YARN-2637: -- I manually kick off Jenkins test again for latest patc

[jira] [Commented] (YARN-2637) maximum-am-resource-percent could be violated when resource of AM is > minimumAllocation

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238140#comment-14238140 ] Hadoop QA commented on YARN-2637: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2892) Unable to get AMRMToken in unmanaged AM when using a secure cluster

2014-12-08 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238137#comment-14238137 ] Rohith commented on YARN-2892: -- bq. the applicationReport return to client include short name

[jira] [Commented] (YARN-2762) RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM

2014-12-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238130#comment-14238130 ] Wangda Tan commented on YARN-2762: -- [~rohithsharma], Thanks for update, Last two minor com

[jira] [Updated] (YARN-2683) registry config options: document and move to core-default

2014-12-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2683: - Attachment: HADOOP-10530-005.patch patch -005; rebased against trunk commit 144da2 > registry con

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238096#comment-14238096 ] Hadoop QA commented on YARN-2910: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2014-12-08 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238075#comment-14238075 ] Mit Desai commented on YARN-2900: - Thanks. I will check that out. > Application (Attempt a

  1   2   >