[jira] [Commented] (YARN-3815) [Aggregation] Application/Flow/User/Queue Level Aggregations

[ https://issues.apache.org/jira/browse/YARN-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593890#comment-14593890 ] Joep Rottinghuis commented on YARN-3815: For flow-level aggregates I'll separately

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Attachment: ProposalOfGenericSchedulingFrameworkForYARN-V1.4.pdf Proposal of Generic Scheduling Framework for

[jira] [Updated] (YARN-3807) Proposal of Guaranteed Capacity Scheduling for YARN

[ https://issues.apache.org/jira/browse/YARN-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3807: --- Attachment: (was: ProposalOfGuaranteedCapacitySchedulingForYARN-V1.2.pdf) Proposal of Guaranteed

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Attachment: (was: ProposalOfGenericSchedulingFrameworkForYARN-V1.3.pdf) Proposal of Generic Scheduling

[jira] [Updated] (YARN-3807) Proposal of Guaranteed Capacity Scheduling for YARN

[ https://issues.apache.org/jira/browse/YARN-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3807: --- Attachment: ProposalOfGuaranteedCapacitySchedulingForYARN-V1.3.pdf Proposal of Guaranteed Capacity Scheduling

[jira] [Updated] (YARN-3808) Proposal of Time Based Fair Scheduling for YARN

[ https://issues.apache.org/jira/browse/YARN-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3808: --- Attachment: (was: ProposalOfTimeBasedFairSchedulingForYARN-V1.0.pdf) Proposal of Time Based Fair

[jira] [Updated] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3051: -- Attachment: YARN-3051.Reader_API_3.patch Add more explanation according Joep's comment. Will do some

[jira] [Updated] (YARN-3808) Proposal of Time Based Fair Scheduling for YARN

[ https://issues.apache.org/jira/browse/YARN-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3808: --- Attachment: ProposalOfTimeBasedFairSchedulingForYARN-V1.1.pdf Proposal of Time Based Fair Scheduling for YARN

[jira] [Commented] (YARN-3802) Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected.

[ https://issues.apache.org/jira/browse/YARN-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594139#comment-14594139 ] Hudson commented on YARN-3802: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2161 (See

[jira] [Updated] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3051: -- Attachment: YARN-3051.Reader_API_2.patch [Storage abstraction] Create backing storage read interface

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594029#comment-14594029 ] Zhijie Shen commented on YARN-3051: --- Thanks for chiming in, Jeop! Here's my reply: bq.

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593944#comment-14593944 ] Zhijie Shen commented on YARN-3116: --- [~giovanni.fumarola], thanks for the patch. Two

[jira] [Commented] (YARN-3792) Test case failures in TestDistributedShell and some issue fixes related to ATSV2

[ https://issues.apache.org/jira/browse/YARN-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594025#comment-14594025 ] Sangjin Lee commented on YARN-3792: --- I tested the latest patch, and at least on my local

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594080#comment-14594080 ] Joep Rottinghuis commented on YARN-3051: The same question goes for the items in

[jira] [Commented] (YARN-3802) Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected.

[ https://issues.apache.org/jira/browse/YARN-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593960#comment-14593960 ] Hudson commented on YARN-3802: -- FAILURE: Integrated in Hadoop-Yarn-trunk #963 (See

[jira] [Updated] (YARN-3805) Update the documentation of Disk Checker based on YARN-90

[ https://issues.apache.org/jira/browse/YARN-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated YARN-3805: --- Attachment: YARN-3805.001.patch Update the documentation of Disk Checker based on YARN-90

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594067#comment-14594067 ] Joep Rottinghuis commented on YARN-3051: Thanks [~zjshen] those additional comments

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594098#comment-14594098 ] Zhijie Shen commented on YARN-3051: --- Yeah, I meant to be AND logic for these parameters.

[jira] [Commented] (YARN-3830) AbstractYarnScheduler.createReleaseCache may try to clean a null attempt

[ https://issues.apache.org/jira/browse/YARN-3830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593967#comment-14593967 ] Hadoop QA commented on YARN-3830: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp and maxResource from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-3176: -- Summary: In Fair Scheduler, child queue should inherit maxApp and maxResource from its parent (was: In Fair

[jira] [Commented] (YARN-3805) Update the documentation of Disk Checker based on YARN-90

[ https://issues.apache.org/jira/browse/YARN-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593951#comment-14593951 ] Masatake Iwasaki commented on YARN-3805: The patch conflicts with the one in

[jira] [Updated] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-3176: -- Attachment: YARN-3176.v2.patch In Fair Scheduler, child queue should inherit maxApp from its parent

[jira] [Updated] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-3176: -- Summary: In Fair Scheduler, child queue should inherit maxApp from its parent (was: In Fair Scheduler, child

[jira] [Commented] (YARN-3802) Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected.

[ https://issues.apache.org/jira/browse/YARN-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593879#comment-14593879 ] Hudson commented on YARN-3802: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #233 (See

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594192#comment-14594192 ] Sangjin Lee commented on YARN-3051: --- I'd like to discuss {{KeyValuePair}}. We're using

[jira] [Assigned] (YARN-1427) yarn-env.cmd should have the analog comments that are in yarn-env.sh

[ https://issues.apache.org/jira/browse/YARN-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang reassigned YARN-1427: -- Assignee: Zhiyuan Yang yarn-env.cmd should have the analog comments that are in yarn-env.sh

[jira] [Updated] (YARN-3835) hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml

[ https://issues.apache.org/jira/browse/YARN-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vamsee Yarlagadda updated YARN-3835: Attachment: YARN-3835.patch This patch will fix the issue on

[jira] [Commented] (YARN-3802) Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected.

[ https://issues.apache.org/jira/browse/YARN-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594218#comment-14594218 ] Hudson commented on YARN-3802: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #231 (See

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594249#comment-14594249 ] Zhijie Shen commented on YARN-3051: --- And if we process a bulk configs such as loading a

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594243#comment-14594243 ] Sangjin Lee commented on YARN-3051: --- Hadoop's {{Configuration}} is actually (string,

[jira] [Commented] (YARN-3834) Scrub debug logging of tokens during resource localization.

[ https://issues.apache.org/jira/browse/YARN-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594267#comment-14594267 ] Hadoop QA commented on YARN-3834: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3808) Proposal of Time Based Fair Scheduling for YARN

[ https://issues.apache.org/jira/browse/YARN-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3808: --- Attachment: (was: ProposalOfTimeBasedFairSchedulingForYARN-V1.1.pdf) Proposal of Time Based Fair

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594170#comment-14594170 ] Joep Rottinghuis commented on YARN-3051: When discussing with [~sjlee0] we noticed

[jira] [Assigned] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C reassigned YARN-3836: Assignee: Vrushali C add equals and hashCode to TimelineEntity and other classes in the data model

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594229#comment-14594229 ] Vrushali C commented on YARN-3836: -- I'll take this up unless someone else wants to. add

[jira] [Commented] (YARN-3798) ZKRMStateStore shouldn't create new session without occurrance of SESSIONEXPIED

[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594221#comment-14594221 ] Hadoop QA commented on YARN-3798: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3820) Collect disks usages on the node

[ https://issues.apache.org/jira/browse/YARN-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594231#comment-14594231 ] Robert Grandl commented on YARN-3820: - [~hadoopqa] - could you please rerun the checks

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594416#comment-14594416 ] Vrushali C commented on YARN-3836: -- Alright, sounds good. Will do the above.. add

[jira] [Commented] (YARN-3802) Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected.

[ https://issues.apache.org/jira/browse/YARN-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594177#comment-14594177 ] Hudson commented on YARN-3802: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #222 (See

[jira] [Created] (YARN-3835) hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml

Vamsee Yarlagadda created YARN-3835: --- Summary: hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml Key: YARN-3835 URL: https://issues.apache.org/jira/browse/YARN-3835

[jira] [Updated] (YARN-3835) hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml

[ https://issues.apache.org/jira/browse/YARN-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vamsee Yarlagadda updated YARN-3835: Affects Version/s: 2.6.0 hadoop-yarn-server-resourcemanager test package bundles

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594194#comment-14594194 ] Hadoop QA commented on YARN-3051: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3792) Test case failures in TestDistributedShell and some issue fixes related to ATSV2

[ https://issues.apache.org/jira/browse/YARN-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594265#comment-14594265 ] Hadoop QA commented on YARN-3792: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594180#comment-14594180 ] Sangjin Lee commented on YARN-3051: --- To clarify, I think as a rule it would be good for

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594209#comment-14594209 ] Zhijie Shen commented on YARN-3051: --- Good catch! I reverted it back to map. Set is the

[jira] [Updated] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3051: -- Attachment: YARN-3051.Reader_API_4.patch [Storage abstraction] Create backing storage read interface

[jira] [Assigned] (YARN-3811) NM restarts could lead to app failures

[ https://issues.apache.org/jira/browse/YARN-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter reassigned YARN-3811: --- Assignee: Robert Kanter (was: Karthik Kambatla) [~kasha] said I can take this over. NM

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594224#comment-14594224 ] Sangjin Lee commented on YARN-3051: --- YARN-3836 added. [Storage abstraction] Create

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594241#comment-14594241 ] Joep Rottinghuis commented on YARN-3051: Can somebody please remind me why

[jira] [Commented] (YARN-3802) Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected.

[ https://issues.apache.org/jira/browse/YARN-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594256#comment-14594256 ] Hudson commented on YARN-3802: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2179 (See

[jira] [Commented] (YARN-3802) Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected.

[ https://issues.apache.org/jira/browse/YARN-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594277#comment-14594277 ] Hudson commented on YARN-3802: -- FAILURE: Integrated in Hadoop-trunk-Commit #8039 (See

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594410#comment-14594410 ] Zhijie Shen commented on YARN-3051: --- [~varun_saxena], would you please take over the

[jira] [Created] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

Sangjin Lee created YARN-3836: - Summary: add equals and hashCode to TimelineEntity and other classes in the data model Key: YARN-3836 URL: https://issues.apache.org/jira/browse/YARN-3836 Project: Hadoop

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594244#comment-14594244 ] Hadoop QA commented on YARN-3047: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3808) Proposal of Time Based Fair Scheduling for YARN

[ https://issues.apache.org/jira/browse/YARN-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3808: --- Attachment: ProposalOfTimeBasedFairSchedulingForYARN-V1.02.pdf Proposal of Time Based Fair Scheduling for

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Attachment: ProposalOfGenericSchedulingFrameworkForYARN-V1.05.pdf Proposal of Generic Scheduling Framework

[jira] [Updated] (YARN-3807) Proposal of Guaranteed Capacity Scheduling for YARN

[ https://issues.apache.org/jira/browse/YARN-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3807: --- Attachment: ProposalOfGuaranteedCapacitySchedulingForYARN-V1.04.pdf Proposal of Guaranteed Capacity

[jira] [Commented] (YARN-3809) Failed to launch new attempts because ApplicationMasterLauncher's threads all hang

[ https://issues.apache.org/jira/browse/YARN-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594300#comment-14594300 ] Jun Gong commented on YARN-3809: [~jlowe] Thank you for the very detailed suggestions. It

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Attachment: (was: ProposalOfGenericSchedulingFrameworkForYARN-V1.4.pdf) Proposal of Generic Scheduling

[jira] [Updated] (YARN-3807) Proposal of Guaranteed Capacity Scheduling for YARN

[ https://issues.apache.org/jira/browse/YARN-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3807: --- Attachment: (was: ProposalOfGuaranteedCapacitySchedulingForYARN-V1.3.pdf) Proposal of Guaranteed

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594413#comment-14594413 ] Joep Rottinghuis commented on YARN-3836: [~vrushalic] when you're tackling

[jira] [Created] (YARN-3830) AbstractYarnScheduler.createReleaseCache may try to clean a null attempt

nijel created YARN-3830: --- Summary: AbstractYarnScheduler.createReleaseCache may try to clean a null attempt Key: YARN-3830 URL: https://issues.apache.org/jira/browse/YARN-3830 Project: Hadoop YARN

[jira] [Commented] (YARN-3832) Resource Localization fails on a cluster due to existing cache directories

[ https://issues.apache.org/jira/browse/YARN-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593424#comment-14593424 ] Jason Lowe commented on YARN-3832: -- It looks like the state store became out-of-sync with

[jira] [Commented] (YARN-3832) Resource Localization fails on a cluster due to existing cache directories

[ https://issues.apache.org/jira/browse/YARN-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593439#comment-14593439 ] Varun Saxena commented on YARN-3832: Sorry meant for [~singar.ranga] Resource

[jira] [Updated] (YARN-3809) Failed to launch new attempts because ApplicationMasterLauncher's threads all hang

[ https://issues.apache.org/jira/browse/YARN-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-3809: --- Attachment: YARN-3809.02.patch Failed to launch new attempts because ApplicationMasterLauncher's threads all

[jira] [Commented] (YARN-3832) Resource Localization fails on a cluster due to existing cache directories

[ https://issues.apache.org/jira/browse/YARN-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593432#comment-14593432 ] Varun Saxena commented on YARN-3832: [~ranga swamy], can you attach the logs ?

[jira] [Commented] (YARN-3809) Failed to launch new attempts because ApplicationMasterLauncher's threads all hang

[ https://issues.apache.org/jira/browse/YARN-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593452#comment-14593452 ] Jun Gong commented on YARN-3809: [~jlowe] Thanks for explanation and suggestions. I

[jira] [Created] (YARN-3833) TestWorkPreservingRMRestart#testSchedulerRecovery fails in trunk

Jun Gong created YARN-3833: -- Summary: TestWorkPreservingRMRestart#testSchedulerRecovery fails in trunk Key: YARN-3833 URL: https://issues.apache.org/jira/browse/YARN-3833 Project: Hadoop YARN

[jira] [Created] (YARN-3832) Resource Localization fails on a cluster due to existing cache directories

Ranga Swamy created YARN-3832: - Summary: Resource Localization fails on a cluster due to existing cache directories Key: YARN-3832 URL: https://issues.apache.org/jira/browse/YARN-3832 Project: Hadoop

[jira] [Created] (YARN-3831) Localization failed when a local disk turns from bad to good without NM initializes it

Jun Gong created YARN-3831: -- Summary: Localization failed when a local disk turns from bad to good without NM initializes it Key: YARN-3831 URL: https://issues.apache.org/jira/browse/YARN-3831 Project:

[jira] [Updated] (YARN-3792) Test case failures in TestDistributedShell and some issue fixes related to ATSV2

[ https://issues.apache.org/jira/browse/YARN-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-3792: Attachment: YARN-3792-YARN-2928.002.patch [~sjlee0], I have updated the patch with the your

[jira] [Commented] (YARN-3826) Race condition in ResourceTrackerService: potential wrong diagnostics messages

[ https://issues.apache.org/jira/browse/YARN-3826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593318#comment-14593318 ] Devaraj K commented on YARN-3826: - Thanks [~chengbing.liu] for the patch. bq. Since we are

[jira] [Commented] (YARN-3798) ZKRMStateStore shouldn't create new session without occurrance of SESSIONEXPIED

[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593221#comment-14593221 ] Rakesh R commented on YARN-3798: [~varun_saxena], sorry I didn't see your ping. I have gone

[jira] [Commented] (YARN-3779) Aggregated Logs Deletion doesnt work after refreshing Log Retention Settings in secure cluster

[ https://issues.apache.org/jira/browse/YARN-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593386#comment-14593386 ] Varun Saxena commented on YARN-3779: [~vinodkv], [~zjshen], I had checked

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593062#comment-14593062 ] Varun Saxena commented on YARN-3047: Fixed a couple of checkstyle issues regarding

[jira] [Updated] (YARN-3830) AbstractYarnScheduler.createReleaseCache may try to clean a null attempt

[ https://issues.apache.org/jira/browse/YARN-3830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nijel updated YARN-3830: Attachment: YARN-3830_1.patch Updated the patch. Please review AbstractYarnScheduler.createReleaseCache may try to

[jira] [Commented] (YARN-3798) ZKRMStateStore shouldn't create new session without occurrance of SESSIONEXPIED

[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593110#comment-14593110 ] Tsuyoshi Ozawa commented on YARN-3798: -- [~vinodkv] [~varun_saxena] Feel free to ask me

[jira] [Commented] (YARN-3833) TestWorkPreservingRMRestart#testSchedulerRecovery fails in trunk

[ https://issues.apache.org/jira/browse/YARN-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593476#comment-14593476 ] Jun Gong commented on YARN-3833: [~brahmareddy] Thank you. Closing it now.

[jira] [Commented] (YARN-3591) Resource Localisation on a bad disk causes subsequent containers failure

[ https://issues.apache.org/jira/browse/YARN-3591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593472#comment-14593472 ] Jason Lowe commented on YARN-3591: -- One potential issue with that approach is long-running

[jira] [Resolved] (YARN-3833) TestWorkPreservingRMRestart#testSchedulerRecovery fails in trunk

[ https://issues.apache.org/jira/browse/YARN-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong resolved YARN-3833. Resolution: Duplicate TestWorkPreservingRMRestart#testSchedulerRecovery fails in trunk

[jira] [Commented] (YARN-3826) Race condition in ResourceTrackerService: potential wrong diagnostics messages

[ https://issues.apache.org/jira/browse/YARN-3826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593532#comment-14593532 ] Chengbing Liu commented on YARN-3826: - [~devaraj.k], is it possible that two heartbeats

[jira] [Commented] (YARN-3832) Resource Localization fails on a cluster due to existing cache directories

[ https://issues.apache.org/jira/browse/YARN-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593541#comment-14593541 ] Jason Lowe commented on YARN-3832: -- bq. AFAIK statestore recreated after starting So if

[jira] [Commented] (YARN-3833) TestWorkPreservingRMRestart#testSchedulerRecovery fails in trunk

[ https://issues.apache.org/jira/browse/YARN-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593473#comment-14593473 ] Brahma Reddy Battula commented on YARN-3833: Dupe of YARN-3790..

[jira] [Commented] (YARN-3809) Failed to launch new attempts because ApplicationMasterLauncher's threads all hang

[ https://issues.apache.org/jira/browse/YARN-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593490#comment-14593490 ] Jason Lowe commented on YARN-3809: -- Thanks for updating the patch, Jun.

[jira] [Commented] (YARN-3832) Resource Localization fails on a cluster due to existing cache directories

[ https://issues.apache.org/jira/browse/YARN-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593497#comment-14593497 ] Brahma Reddy Battula commented on YARN-3832: [~jlowe] Thanks for looking into

[jira] [Commented] (YARN-3815) [Aggregation] Application/Flow/User/Queue Level Aggregations

[ https://issues.apache.org/jira/browse/YARN-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593649#comment-14593649 ] Sangjin Lee commented on YARN-3815: --- Thanks [~djp] for putting this together. I added

[jira] [Updated] (YARN-3528) Tests with 12345 as hard-coded port break jenkins

[ https://issues.apache.org/jira/browse/YARN-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-3528: --- Attachment: YARN-3528-002.patch Tests with 12345 as hard-coded port break jenkins

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593627#comment-14593627 ] Zhijie Shen commented on YARN-3051: --- First of all, I'd like to say it's not the finalized

[jira] [Updated] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3051: -- Attachment: YARN-3051.Reader_API_1.patch [Storage abstraction] Create backing storage read interface

[jira] [Commented] (YARN-3528) Tests with 12345 as hard-coded port break jenkins

[ https://issues.apache.org/jira/browse/YARN-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593577#comment-14593577 ] Varun Saxena commented on YARN-3528: Also just a suggestion, maybe can pass a start and

[jira] [Commented] (YARN-3528) Tests with 12345 as hard-coded port break jenkins

[ https://issues.apache.org/jira/browse/YARN-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593587#comment-14593587 ] Brahma Reddy Battula commented on YARN-3528: [~varun_saxena] thanks for looking

[jira] [Commented] (YARN-3798) ZKRMStateStore shouldn't create new session without occurrance of SESSIONEXPIED

[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593676#comment-14593676 ] Jian He commented on YARN-3798: --- [~rakeshr], thanks for coming to this. I have one question,

[jira] [Created] (YARN-3834) Scrub debug logging of tokens during resource localization.

Chris Nauroth created YARN-3834: --- Summary: Scrub debug logging of tokens during resource localization. Key: YARN-3834 URL: https://issues.apache.org/jira/browse/YARN-3834 Project: Hadoop YARN

[jira] [Updated] (YARN-3834) Scrub debug logging of tokens during resource localization.

[ https://issues.apache.org/jira/browse/YARN-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated YARN-3834: Attachment: YARN-3834.001.patch The attached patch changes the code to use {{Token#toString}}. The

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593710#comment-14593710 ] Varun Saxena commented on YARN-3051: Thanks [~zjshen] for your comments. bq. Yeah, we

[jira] [Commented] (YARN-3779) Aggregated Logs Deletion doesnt work after refreshing Log Retention Settings in secure cluster

[ https://issues.apache.org/jira/browse/YARN-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593738#comment-14593738 ] Varun Saxena commented on YARN-3779: Will update the patch as per suggestions tomorrow

[jira] [Commented] (YARN-2801) Documentation development for Node labels requirment

[ https://issues.apache.org/jira/browse/YARN-2801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593748#comment-14593748 ] Naganarasimha G R commented on YARN-2801: - Hi [~leftnoteasy] Had a few points from

[jira] [Commented] (YARN-3779) Aggregated Logs Deletion doesnt work after refreshing Log Retention Settings in secure cluster

[ https://issues.apache.org/jira/browse/YARN-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593855#comment-14593855 ] Vinod Kumar Vavilapalli commented on YARN-3779: --- [~varun_saxena], I agree

[jira] [Commented] (YARN-3811) NM restarts could lead to app failures

[ https://issues.apache.org/jira/browse/YARN-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593852#comment-14593852 ] Vinod Kumar Vavilapalli commented on YARN-3811: --- bq. For NM work-preserving

[jira] [Commented] (YARN-3815) [Aggregation] Application/Flow/User/Queue Level Aggregations

[ https://issues.apache.org/jira/browse/YARN-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593867#comment-14593867 ] Joep Rottinghuis commented on YARN-3815: Very much agree with separation into 2

  1   2   >