[jira] [Commented] (YARN-3831) Localization failed when a local disk turns from bad to good without NM initializes it

2015-06-19 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594431#comment-14594431 ] zhihai xu commented on YARN-3831: - Hi [~hex108], thanks for reporting this issue, What vers

[jira] [Commented] (YARN-3809) Failed to launch new attempts because ApplicationMasterLauncher's threads all hang

2015-06-19 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594424#comment-14594424 ] Jun Gong commented on YARN-3809: Attach a new patch to address [~jlowe] 's suggestions. Tha

[jira] [Updated] (YARN-3809) Failed to launch new attempts because ApplicationMasterLauncher's threads all hang

2015-06-19 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-3809: --- Attachment: YARN-3809.03.patch > Failed to launch new attempts because ApplicationMasterLauncher's threads all

[jira] [Commented] (YARN-3779) Aggregated Logs Deletion doesnt work after refreshing Log Retention Settings in secure cluster

2015-06-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594423#comment-14594423 ] Varun Saxena commented on YARN-3779: [~vinodkv], thats correct. So do you want me to ra

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-06-19 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594416#comment-14594416 ] Vrushali C commented on YARN-3836: -- Alright, sounds good. Will do the above.. > add equa

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-06-19 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594413#comment-14594413 ] Joep Rottinghuis commented on YARN-3836: [~vrushalic] when you're tackling Timeline

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594410#comment-14594410 ] Zhijie Shen commented on YARN-3051: --- [~varun_saxena], would you please take over the read

[jira] [Updated] (YARN-3808) Proposal of Time Based Fair Scheduling for YARN

2015-06-19 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3808: --- Attachment: (was: ProposalOfTimeBasedFairSchedulingForYARN-V1.1.pdf) > Proposal of Time Based Fair Scheduli

[jira] [Updated] (YARN-3808) Proposal of Time Based Fair Scheduling for YARN

2015-06-19 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3808: --- Attachment: ProposalOfTimeBasedFairSchedulingForYARN-V1.02.pdf > Proposal of Time Based Fair Scheduling for YAR

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-19 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Attachment: ProposalOfGenericSchedulingFrameworkForYARN-V1.05.pdf > Proposal of Generic Scheduling Framework fo

[jira] [Updated] (YARN-3807) Proposal of Guaranteed Capacity Scheduling for YARN

2015-06-19 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3807: --- Attachment: ProposalOfGuaranteedCapacitySchedulingForYARN-V1.04.pdf > Proposal of Guaranteed Capacity Schedulin

[jira] [Commented] (YARN-3809) Failed to launch new attempts because ApplicationMasterLauncher's threads all hang

2015-06-19 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594300#comment-14594300 ] Jun Gong commented on YARN-3809: [~jlowe] Thank you for the very detailed suggestions. It h

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-19 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Attachment: (was: ProposalOfGenericSchedulingFrameworkForYARN-V1.4.pdf) > Proposal of Generic Scheduling Fr

[jira] [Updated] (YARN-3807) Proposal of Guaranteed Capacity Scheduling for YARN

2015-06-19 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3807: --- Attachment: (was: ProposalOfGuaranteedCapacitySchedulingForYARN-V1.3.pdf) > Proposal of Guaranteed Capacit

[jira] [Commented] (YARN-3802) Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected.

2015-06-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594277#comment-14594277 ] Hudson commented on YARN-3802: -- FAILURE: Integrated in Hadoop-trunk-Commit #8039 (See [https:

[jira] [Commented] (YARN-3834) Scrub debug logging of tokens during resource localization.

2015-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594267#comment-14594267 ] Hadoop QA commented on YARN-3834: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3792) Test case failures in TestDistributedShell and some issue fixes related to ATSV2

2015-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594265#comment-14594265 ] Hadoop QA commented on YARN-3792: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3802) Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected.

2015-06-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594256#comment-14594256 ] Hudson commented on YARN-3802: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2179 (See [htt

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594249#comment-14594249 ] Zhijie Shen commented on YARN-3051: --- And if we process a bulk configs such as loading a c

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594244#comment-14594244 ] Hadoop QA commented on YARN-3047: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594243#comment-14594243 ] Sangjin Lee commented on YARN-3051: --- Hadoop's {{Configuration}} is actually (string, stri

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594241#comment-14594241 ] Joep Rottinghuis commented on YARN-3051: Can somebody please remind me why Timeline

[jira] [Commented] (YARN-3820) Collect disks usages on the node

2015-06-19 Thread Robert Grandl (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594231#comment-14594231 ] Robert Grandl commented on YARN-3820: - [~hadoopqa] - could you please rerun the checks

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-06-19 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594229#comment-14594229 ] Vrushali C commented on YARN-3836: -- I'll take this up unless someone else wants to. > ad

[jira] [Assigned] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-06-19 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C reassigned YARN-3836: Assignee: Vrushali C > add equals and hashCode to TimelineEntity and other classes in the data model

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594224#comment-14594224 ] Sangjin Lee commented on YARN-3051: --- YARN-3836 added. > [Storage abstraction] Create bac

[jira] [Created] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-06-19 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3836: - Summary: add equals and hashCode to TimelineEntity and other classes in the data model Key: YARN-3836 URL: https://issues.apache.org/jira/browse/YARN-3836 Project: Hadoop Y

[jira] [Commented] (YARN-3798) ZKRMStateStore shouldn't create new session without occurrance of SESSIONEXPIED

2015-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594221#comment-14594221 ] Hadoop QA commented on YARN-3798: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3802) Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected.

2015-06-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594218#comment-14594218 ] Hudson commented on YARN-3802: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #231 (See

[jira] [Assigned] (YARN-3811) NM restarts could lead to app failures

2015-06-19 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter reassigned YARN-3811: --- Assignee: Robert Kanter (was: Karthik Kambatla) [~kasha] said I can take this over. > NM res

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594209#comment-14594209 ] Zhijie Shen commented on YARN-3051: --- Good catch! I reverted it back to map. Set is the le

[jira] [Updated] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3051: -- Attachment: YARN-3051.Reader_API_4.patch > [Storage abstraction] Create backing storage read interface fo

[jira] [Assigned] (YARN-1427) yarn-env.cmd should have the analog comments that are in yarn-env.sh

2015-06-19 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang reassigned YARN-1427: -- Assignee: Zhiyuan Yang > yarn-env.cmd should have the analog comments that are in yarn-env.sh >

[jira] [Updated] (YARN-3835) hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml

2015-06-19 Thread Vamsee Yarlagadda (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vamsee Yarlagadda updated YARN-3835: Attachment: YARN-3835.patch This patch will fix the issue on hadoop-yarn-server-resourcemanag

[jira] [Created] (YARN-3835) hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml

2015-06-19 Thread Vamsee Yarlagadda (JIRA)
Vamsee Yarlagadda created YARN-3835: --- Summary: hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml Key: YARN-3835 URL: https://issues.apache.org/jira/browse/YARN-3835

[jira] [Updated] (YARN-3835) hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml

2015-06-19 Thread Vamsee Yarlagadda (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vamsee Yarlagadda updated YARN-3835: Affects Version/s: 2.6.0 > hadoop-yarn-server-resourcemanager test package bundles core-site.

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594194#comment-14594194 ] Hadoop QA commented on YARN-3051: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594192#comment-14594192 ] Sangjin Lee commented on YARN-3051: --- I'd like to discuss {{KeyValuePair}}. We're using {{

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594180#comment-14594180 ] Sangjin Lee commented on YARN-3051: --- To clarify, I think as a rule it would be good for t

[jira] [Commented] (YARN-3802) Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected.

2015-06-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594177#comment-14594177 ] Hudson commented on YARN-3802: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #222 (See [htt

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594170#comment-14594170 ] Joep Rottinghuis commented on YARN-3051: When discussing with [~sjlee0] we noticed

[jira] [Commented] (YARN-3802) Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected.

2015-06-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594139#comment-14594139 ] Hudson commented on YARN-3802: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2161 (See [https://

[jira] [Updated] (YARN-3808) Proposal of Time Based Fair Scheduling for YARN

2015-06-19 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3808: --- Attachment: ProposalOfTimeBasedFairSchedulingForYARN-V1.1.pdf > Proposal of Time Based Fair Scheduling for YARN

[jira] [Updated] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3051: -- Attachment: YARN-3051.Reader_API_3.patch Add more explanation according Joep's comment. Will do some inve

[jira] [Updated] (YARN-3808) Proposal of Time Based Fair Scheduling for YARN

2015-06-19 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3808: --- Attachment: (was: ProposalOfTimeBasedFairSchedulingForYARN-V1.0.pdf) > Proposal of Time Based Fair Scheduli

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-19 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Attachment: (was: ProposalOfGenericSchedulingFrameworkForYARN-V1.3.pdf) > Proposal of Generic Scheduling Fr

[jira] [Updated] (YARN-3807) Proposal of Guaranteed Capacity Scheduling for YARN

2015-06-19 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3807: --- Attachment: ProposalOfGuaranteedCapacitySchedulingForYARN-V1.3.pdf > Proposal of Guaranteed Capacity Scheduling

[jira] [Updated] (YARN-3807) Proposal of Guaranteed Capacity Scheduling for YARN

2015-06-19 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3807: --- Attachment: (was: ProposalOfGuaranteedCapacitySchedulingForYARN-V1.2.pdf) > Proposal of Guaranteed Capacit

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-19 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Attachment: ProposalOfGenericSchedulingFrameworkForYARN-V1.4.pdf > Proposal of Generic Scheduling Framework for

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594098#comment-14594098 ] Zhijie Shen commented on YARN-3051: --- Yeah, I meant to be AND logic for these parameters.

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594080#comment-14594080 ] Joep Rottinghuis commented on YARN-3051: The same question goes for the items in th

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594067#comment-14594067 ] Joep Rottinghuis commented on YARN-3051: Thanks [~zjshen] those additional comments

[jira] [Updated] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3051: -- Attachment: YARN-3051.Reader_API_2.patch > [Storage abstraction] Create backing storage read interface fo

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594029#comment-14594029 ] Zhijie Shen commented on YARN-3051: --- Thanks for chiming in, Jeop! Here's my reply: bq. I

[jira] [Commented] (YARN-3792) Test case failures in TestDistributedShell and some issue fixes related to ATSV2

2015-06-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594025#comment-14594025 ] Sangjin Lee commented on YARN-3792: --- I tested the latest patch, and at least on my local

[jira] [Updated] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-06-19 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-3176: -- Attachment: YARN-3176.v2.patch > In Fair Scheduler, child queue should inherit maxApp from its parent > -

[jira] [Updated] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-06-19 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-3176: -- Summary: In Fair Scheduler, child queue should inherit maxApp from its parent (was: In Fair Scheduler, child que

[jira] [Updated] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp and maxResource from its parent

2015-06-19 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-3176: -- Summary: In Fair Scheduler, child queue should inherit maxApp and maxResource from its parent (was: In Fair Sche

[jira] [Commented] (YARN-3830) AbstractYarnScheduler.createReleaseCache may try to clean a null attempt

2015-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593967#comment-14593967 ] Hadoop QA commented on YARN-3830: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3802) Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected.

2015-06-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593960#comment-14593960 ] Hudson commented on YARN-3802: -- FAILURE: Integrated in Hadoop-Yarn-trunk #963 (See [https://b

[jira] [Commented] (YARN-3805) Update the documentation of Disk Checker based on YARN-90

2015-06-19 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593951#comment-14593951 ] Masatake Iwasaki commented on YARN-3805: The patch conflicts with the one in YARN-3

[jira] [Updated] (YARN-3805) Update the documentation of Disk Checker based on YARN-90

2015-06-19 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated YARN-3805: --- Attachment: YARN-3805.001.patch > Update the documentation of Disk Checker based on YARN-90 > -

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

2015-06-19 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593944#comment-14593944 ] Zhijie Shen commented on YARN-3116: --- [~giovanni.fumarola], thanks for the patch. Two quic

[jira] [Commented] (YARN-3815) [Aggregation] Application/Flow/User/Queue Level Aggregations

2015-06-19 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593890#comment-14593890 ] Joep Rottinghuis commented on YARN-3815: For flow-level aggregates I'll separately

[jira] [Commented] (YARN-3802) Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected.

2015-06-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593879#comment-14593879 ] Hudson commented on YARN-3802: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #233 (See [htt

[jira] [Commented] (YARN-3815) [Aggregation] Application/Flow/User/Queue Level Aggregations

2015-06-19 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593867#comment-14593867 ] Joep Rottinghuis commented on YARN-3815: Very much agree with separation into 2 cat

[jira] [Commented] (YARN-3811) NM restarts could lead to app failures

2015-06-19 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593852#comment-14593852 ] Vinod Kumar Vavilapalli commented on YARN-3811: --- bq. For NM work-preserving

[jira] [Commented] (YARN-3779) Aggregated Logs Deletion doesnt work after refreshing Log Retention Settings in secure cluster

2015-06-19 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593855#comment-14593855 ] Vinod Kumar Vavilapalli commented on YARN-3779: --- [~varun_saxena], I agree wit

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593826#comment-14593826 ] Joep Rottinghuis commented on YARN-3051: Not all arguments are equally selective. F

[jira] [Updated] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

2015-06-19 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-3116: --- Attachment: YARN-3116.patch > [Collector wireup] We need an assured way to dete

[jira] [Reopened] (YARN-3521) Support return structured NodeLabel objects in REST API

2015-06-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reopened YARN-3521: -- Reopen to change to correct resolution > Support return structured NodeLabel objects in REST API > -

[jira] [Resolved] (YARN-3521) Support return structured NodeLabel objects in REST API

2015-06-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-3521. -- Resolution: Fixed > Support return structured NodeLabel objects in REST API > ---

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-06-19 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593754#comment-14593754 ] Sidharta Seethana commented on YARN-2194: - [~ywskycn] , the latest patch (v6) looks

[jira] [Commented] (YARN-2801) Documentation development for Node labels requirment

2015-06-19 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593748#comment-14593748 ] Naganarasimha G R commented on YARN-2801: - Hi [~leftnoteasy] Had a few points from

[jira] [Commented] (YARN-3779) Aggregated Logs Deletion doesnt work after refreshing Log Retention Settings in secure cluster

2015-06-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593738#comment-14593738 ] Varun Saxena commented on YARN-3779: Will update the patch as per suggestions tomorrow

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593710#comment-14593710 ] Varun Saxena commented on YARN-3051: Thanks [~zjshen] for your comments. bq. Yeah, we

[jira] [Updated] (YARN-3834) Scrub debug logging of tokens during resource localization.

2015-06-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated YARN-3834: Attachment: YARN-3834.001.patch The attached patch changes the code to use {{Token#toString}}. The

[jira] [Created] (YARN-3834) Scrub debug logging of tokens during resource localization.

2015-06-19 Thread Chris Nauroth (JIRA)
Chris Nauroth created YARN-3834: --- Summary: Scrub debug logging of tokens during resource localization. Key: YARN-3834 URL: https://issues.apache.org/jira/browse/YARN-3834 Project: Hadoop YARN

[jira] [Commented] (YARN-3798) ZKRMStateStore shouldn't create new session without occurrance of SESSIONEXPIED

2015-06-19 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593676#comment-14593676 ] Jian He commented on YARN-3798: --- [~rakeshr], thanks for coming to this. I have one question,

[jira] [Commented] (YARN-3815) [Aggregation] Application/Flow/User/Queue Level Aggregations

2015-06-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593649#comment-14593649 ] Sangjin Lee commented on YARN-3815: --- Thanks [~djp] for putting this together. I added com

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593627#comment-14593627 ] Zhijie Shen commented on YARN-3051: --- First of all, I'd like to say it's not the finalized

[jira] [Updated] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-19 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3051: -- Attachment: YARN-3051.Reader_API_1.patch > [Storage abstraction] Create backing storage read interface fo

[jira] [Commented] (YARN-3528) Tests with 12345 as hard-coded port break jenkins

2015-06-19 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593587#comment-14593587 ] Brahma Reddy Battula commented on YARN-3528: [~varun_saxena] thanks for looking

[jira] [Updated] (YARN-3528) Tests with 12345 as hard-coded port break jenkins

2015-06-19 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-3528: --- Attachment: YARN-3528-002.patch > Tests with 12345 as hard-coded port break jenkins > -

[jira] [Commented] (YARN-3528) Tests with 12345 as hard-coded port break jenkins

2015-06-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593577#comment-14593577 ] Varun Saxena commented on YARN-3528: Also just a suggestion, maybe can pass a start and

[jira] [Commented] (YARN-3832) Resource Localization fails on a cluster due to existing cache directories

2015-06-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593541#comment-14593541 ] Jason Lowe commented on YARN-3832: -- bq. AFAIK statestore recreated after starting So if t

[jira] [Commented] (YARN-3826) Race condition in ResourceTrackerService: potential wrong diagnostics messages

2015-06-19 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593532#comment-14593532 ] Chengbing Liu commented on YARN-3826: - [~devaraj.k], is it possible that two heartbeats

[jira] [Commented] (YARN-3832) Resource Localization fails on a cluster due to existing cache directories

2015-06-19 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593497#comment-14593497 ] Brahma Reddy Battula commented on YARN-3832: [~jlowe] Thanks for looking into t

[jira] [Commented] (YARN-3809) Failed to launch new attempts because ApplicationMasterLauncher's threads all hang

2015-06-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593490#comment-14593490 ] Jason Lowe commented on YARN-3809: -- Thanks for updating the patch, Jun. ContainerManageme

[jira] [Commented] (YARN-3833) TestWorkPreservingRMRestart#testSchedulerRecovery fails in trunk

2015-06-19 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593476#comment-14593476 ] Jun Gong commented on YARN-3833: [~brahmareddy] Thank you. Closing it now. > TestWorkPrese

[jira] [Resolved] (YARN-3833) TestWorkPreservingRMRestart#testSchedulerRecovery fails in trunk

2015-06-19 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong resolved YARN-3833. Resolution: Duplicate > TestWorkPreservingRMRestart#testSchedulerRecovery fails in trunk > --

[jira] [Commented] (YARN-3833) TestWorkPreservingRMRestart#testSchedulerRecovery fails in trunk

2015-06-19 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593473#comment-14593473 ] Brahma Reddy Battula commented on YARN-3833: Dupe of YARN-3790.. > TestWorkPre

[jira] [Commented] (YARN-3591) Resource Localisation on a bad disk causes subsequent containers failure

2015-06-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593472#comment-14593472 ] Jason Lowe commented on YARN-3591: -- One potential issue with that approach is long-running

[jira] [Created] (YARN-3833) TestWorkPreservingRMRestart#testSchedulerRecovery fails in trunk

2015-06-19 Thread Jun Gong (JIRA)
Jun Gong created YARN-3833: -- Summary: TestWorkPreservingRMRestart#testSchedulerRecovery fails in trunk Key: YARN-3833 URL: https://issues.apache.org/jira/browse/YARN-3833 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-3809) Failed to launch new attempts because ApplicationMasterLauncher's threads all hang

2015-06-19 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593452#comment-14593452 ] Jun Gong commented on YARN-3809: [~jlowe] Thanks for explanation and suggestions. I misunde

[jira] [Updated] (YARN-3809) Failed to launch new attempts because ApplicationMasterLauncher's threads all hang

2015-06-19 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-3809: --- Attachment: YARN-3809.02.patch > Failed to launch new attempts because ApplicationMasterLauncher's threads all

[jira] [Commented] (YARN-3832) Resource Localization fails on a cluster due to existing cache directories

2015-06-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593439#comment-14593439 ] Varun Saxena commented on YARN-3832: Sorry meant for [~singar.ranga] > Resource Locali

[jira] [Commented] (YARN-3832) Resource Localization fails on a cluster due to existing cache directories

2015-06-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593432#comment-14593432 ] Varun Saxena commented on YARN-3832: [~ranga swamy], can you attach the logs ? > Resou

[jira] [Commented] (YARN-3832) Resource Localization fails on a cluster due to existing cache directories

2015-06-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593424#comment-14593424 ] Jason Lowe commented on YARN-3832: -- It looks like the state store became out-of-sync with

[jira] [Assigned] (YARN-3832) Resource Localization fails on a cluster due to existing cache directories

2015-06-19 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned YARN-3832: -- Assignee: Brahma Reddy Battula > Resource Localization fails on a cluster due to

  1   2   >