[jira] [Created] (YARN-6652) Merge flow info and flow runs

Haibo Chen created YARN-6652: Summary: Merge flow info and flow runs Key: YARN-6652 URL: https://issues.apache.org/jira/browse/YARN-6652 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-6555) Enable flow context read (& corresponding write) for recovering application with NM restart

[ https://issues.apache.org/jira/browse/YARN-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025390#comment-16025390 ] Haibo Chen commented on YARN-6555: -- Thanks [~rohithsharma] for the explanation, and updating the patch!

[jira] [Updated] (YARN-6555) Store application flow context in NM state store for work-preserving restart

[ https://issues.apache.org/jira/browse/YARN-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6555: - Fix Version/s: 3.0.0-alpha3 > Store application flow context in NM state store for work-preserving restart

[jira] [Updated] (YARN-6555) Store application flow context in NM state store for work-preserving restart

[ https://issues.apache.org/jira/browse/YARN-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6555: - Fix Version/s: YARN-5355-branch-2 YARN-5355 > Store application flow context in NM

[jira] [Updated] (YARN-6555) Store application flow context in NM state store for work-preserving restart

[ https://issues.apache.org/jira/browse/YARN-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6555: - Summary: Store application flow context in NM state store for work-preserving restart (was: Enable flow

[jira] [Commented] (YARN-6555) Store application flow context in NM state store for work-preserving restart

[ https://issues.apache.org/jira/browse/YARN-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025843#comment-16025843 ] Haibo Chen commented on YARN-6555: -- Yes, I already committed this into trunk > Store application flow

[jira] [Commented] (YARN-5705) [YARN-3368] Add support for Timeline V2 to new web UI

[ https://issues.apache.org/jira/browse/YARN-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016215#comment-16016215 ] Haibo Chen commented on YARN-5705: -- Thanks [~akhilpb] for the update! I played with the latests patch with

[jira] [Updated] (YARN-6670) Add over-allocation thresholds to allow per-node oversubscription

[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6670: - Summary: Add over-allocation thresholds to allow per-node oversubscription (was: Add over-allocation

[jira] [Created] (YARN-6671) Add container type awareness in ResourceHandlers.

Haibo Chen created YARN-6671: Summary: Add container type awareness in ResourceHandlers. Key: YARN-6671 URL: https://issues.apache.org/jira/browse/YARN-6671 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-6674) Add memory cgroup settings for opportunistic containers

Haibo Chen created YARN-6674: Summary: Add memory cgroup settings for opportunistic containers Key: YARN-6674 URL: https://issues.apache.org/jira/browse/YARN-6674 Project: Hadoop YARN Issue

[jira] [Resolved] (YARN-6656) The column family indicated in AppToFlowTable class javadoc is wrong

[ https://issues.apache.org/jira/browse/YARN-6656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-6656. -- Resolution: Duplicate > The column family indicated in AppToFlowTable class javadoc is wrong >

[jira] [Created] (YARN-6668) Use cgroup to get container resource utilization

Haibo Chen created YARN-6668: Summary: Use cgroup to get container resource utilization Key: YARN-6668 URL: https://issues.apache.org/jira/browse/YARN-6668 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-6671) Add container type awareness in ResourceHandlers.

[ https://issues.apache.org/jira/browse/YARN-6671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6671: - Issue Type: Sub-task (was: Improvement) Parent: YARN-1011 > Add container type awareness in

[jira] [Updated] (YARN-6670) Add over-allocation threshold to allow per-node oversubscription

[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6670: - Summary: Add over-allocation threshold to allow per-node oversubscription (was: Add a new configuration,

[jira] [Updated] (YARN-6672) Add NM preemption of opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6672: - Issue Type: Sub-task (was: Task) Parent: YARN-1011 > Add NM preemption of opportunistic

[jira] [Created] (YARN-6672) Add NM preemption of opportunistic containers

Haibo Chen created YARN-6672: Summary: Add NM preemption of opportunistic containers Key: YARN-6672 URL: https://issues.apache.org/jira/browse/YARN-6672 Project: Hadoop YARN Issue Type: Task

[jira] [Assigned] (YARN-6668) Use cgroup to get container resource utilization

[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-6668: Assignee: Miklos Szegedi (was: Haibo Chen) > Use cgroup to get container resource utilization >

[jira] [Updated] (YARN-6670) Add a new configuration, over-allocation threshold, to allow per-node oversubscription

[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6670: - Issue Type: Sub-task (was: Improvement) Parent: YARN-1011 > Add a new configuration,

[jira] [Updated] (YARN-6668) Use cgroup to get container resource utilization

[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6668: - Issue Type: Sub-task (was: Improvement) Parent: YARN-1011 > Use cgroup to get container resource

[jira] [Updated] (YARN-6674) Add memory cgroup settings for opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6674: - Issue Type: Sub-task (was: Task) Parent: YARN-1011 > Add memory cgroup settings for opportunistic

[jira] [Created] (YARN-6673) Add cpu cgroup configurations for opportunistic containers

Haibo Chen created YARN-6673: Summary: Add cpu cgroup configurations for opportunistic containers Key: YARN-6673 URL: https://issues.apache.org/jira/browse/YARN-6673 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-6673) Add cpu cgroup configurations for opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6673: - Issue Type: Sub-task (was: Task) Parent: YARN-1011 > Add cpu cgroup configurations for

[jira] [Updated] (YARN-6672) Add NM preemption of opportunistic containers when utilization goes high

[ https://issues.apache.org/jira/browse/YARN-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6672: - Summary: Add NM preemption of opportunistic containers when utilization goes high (was: Add NM preemption

[jira] [Commented] (YARN-6657) The column family indicated in AppToFlowTable class javadoc is wrong

[ https://issues.apache.org/jira/browse/YARN-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16028724#comment-16028724 ] Haibo Chen commented on YARN-6657: -- Thanks for pointing it out, [~varun_saxena]. Uploading the correct

[jira] [Updated] (YARN-6657) The column family indicated in AppToFlowTable class javadoc is wrong

[ https://issues.apache.org/jira/browse/YARN-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6657: - Attachment: YARN-6657.00.patch > The column family indicated in AppToFlowTable class javadoc is wrong >

[jira] [Created] (YARN-6675) Add NM support to launch opportunistic containers based on oversubscription

Haibo Chen created YARN-6675: Summary: Add NM support to launch opportunistic containers based on oversubscription Key: YARN-6675 URL: https://issues.apache.org/jira/browse/YARN-6675 Project: Hadoop YARN

[jira] [Updated] (YARN-6675) Add NM support to launch opportunistic containers based on oversubscription

[ https://issues.apache.org/jira/browse/YARN-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6675: - Issue Type: Sub-task (was: Task) Parent: YARN-1011 > Add NM support to launch opportunistic

[jira] [Commented] (YARN-6477) Dispatcher no longer needs the raw types suppression

[ https://issues.apache.org/jira/browse/YARN-6477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16030393#comment-16030393 ] Haibo Chen commented on YARN-6477: -- Thanks [~maya] for your contribution! I have committed it to trunk. >

[jira] [Commented] (YARN-6477) Dispatcher no longer needs the raw types suppression

[ https://issues.apache.org/jira/browse/YARN-6477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16030385#comment-16030385 ] Haibo Chen commented on YARN-6477: -- +1. Checking this in. > Dispatcher no longer needs the raw types

[jira] [Commented] (YARN-6658) Remove columnFor() methods of Columns in HBaseTimeline backend

[ https://issues.apache.org/jira/browse/YARN-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16029782#comment-16029782 ] Haibo Chen commented on YARN-6658: -- This is more of a minor cleanup. Given that this will eventually go

[jira] [Updated] (YARN-5094) some YARN container events have timestamp of -1

[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5094: - Attachment: YARN-5094.00.patch > some YARN container events have timestamp of -1 >

[jira] [Commented] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033932#comment-16033932 ] Haibo Chen commented on YARN-6670: -- Findbug warnings are unrelated. Will update the patch to fix the

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033935#comment-16033935 ] Haibo Chen commented on YARN-5094: -- Thanks [~gtCarrera9] for your comments. Yes, I have limited the change

[jira] [Commented] (YARN-6316) Provide help information and documentation for TimelineSchemaCreator

[ https://issues.apache.org/jira/browse/YARN-6316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033937#comment-16033937 ] Haibo Chen commented on YARN-6316: -- Agreed. Thanks [~vrushalic]! > Provide help information and

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033878#comment-16033878 ] Haibo Chen commented on YARN-5094: -- Sorry, I just realized that AbstractEvent is used in everywhere. To be

[jira] [Assigned] (YARN-5094) some YARN container events have timestamp of -1 in REST output

[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-5094: Assignee: Haibo Chen (was: Li Lu) > some YARN container events have timestamp of -1 in REST output

[jira] [Assigned] (YARN-6199) Support for listing flows with filter userid

[ https://issues.apache.org/jira/browse/YARN-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-6199: Assignee: Haibo Chen > Support for listing flows with filter userid >

[jira] [Updated] (YARN-6604) Allow metric TTL for Application table to be specified through cmd

[ https://issues.apache.org/jira/browse/YARN-6604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6604: - Attachment: YARN-6604.00.patch > Allow metric TTL for Application table to be specified through cmd >

[jira] [Updated] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6670: - Attachment: YARN-6670-YARN-1011.00.patch > Add separate NM overallocation thresholds for cpu and memory >

[jira] [Updated] (YARN-6670) Add separate oversubscription thresholds for cpu and memory

[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6670: - Summary: Add separate oversubscription thresholds for cpu and memory (was: Add separate configurations

[jira] [Updated] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6670: - Summary: Add separate NM overallocation thresholds for cpu and memory (was: Add separate oversubscription

[jira] [Updated] (YARN-5094) some YARN container events have timestamp of -1

[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5094: - Summary: some YARN container events have timestamp of -1 (was: some YARN container events have timestamp

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035116#comment-16035116 ] Haibo Chen commented on YARN-5094: -- Will update the patch to address the unit test failures. > some YARN

[jira] [Updated] (YARN-5094) some YARN container events have timestamp of -1

[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5094: - Attachment: YARN-5094.02.patch Patch updated to ignore ApplicationLocalizationEvent timestamp when

[jira] [Assigned] (YARN-5169) most YARN events have timestamp of -1

[ https://issues.apache.org/jira/browse/YARN-5169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-5169: Assignee: (was: Haibo Chen) > most YARN events have timestamp of -1 >

[jira] [Commented] (YARN-6047) Documentation updates for TimelineService v2

[ https://issues.apache.org/jira/browse/YARN-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035160#comment-16035160 ] Haibo Chen commented on YARN-6047: -- Linked YARN-6382 to document the known writer fault-tolerance issue.

[jira] [Commented] (YARN-6199) Support for listing flows with filter userid

[ https://issues.apache.org/jira/browse/YARN-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035588#comment-16035588 ] Haibo Chen commented on YARN-6199: -- The current /flows query is implemented by setting the scan range. We

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035301#comment-16035301 ] Haibo Chen commented on YARN-5094: -- Will look into it and follow up with a new patch > some YARN

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035282#comment-16035282 ] Haibo Chen commented on YARN-5094: -- Findbug warnings are unrelated. > some YARN container events have

[jira] [Comment Edited] (YARN-6199) Support for listing flows with filter userid

[ https://issues.apache.org/jira/browse/YARN-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16041192#comment-16041192 ] Haibo Chen edited comment on YARN-6199 at 6/7/17 4:46 PM: -- The new patch uses

[jira] [Updated] (YARN-6199) Support for listing flows with filter userid

[ https://issues.apache.org/jira/browse/YARN-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6199: - Attachment: YARN-6199.01.patch The new patch uses SubstringComparator to match {userId}! in the row key.

[jira] [Comment Edited] (YARN-6199) Support for listing flows with filter userid

[ https://issues.apache.org/jira/browse/YARN-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16041192#comment-16041192 ] Haibo Chen edited comment on YARN-6199 at 6/7/17 4:45 PM: -- The new patch uses

[jira] [Commented] (YARN-6199) Support for listing flows with filter userid

[ https://issues.apache.org/jira/browse/YARN-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16041109#comment-16041109 ] Haibo Chen commented on YARN-6199: -- bq. when startdate - specified, how long table scans happens? Does it

[jira] [Commented] (YARN-6604) Allow metric TTL for Application table to be specified through cmd

[ https://issues.apache.org/jira/browse/YARN-6604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16041210#comment-16041210 ] Haibo Chen commented on YARN-6604: -- Thanks [~varun_saxena] for your reviews! > Allow metric TTL for

[jira] [Comment Edited] (YARN-6199) Support for listing flows with filter userid

[ https://issues.apache.org/jira/browse/YARN-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16041192#comment-16041192 ] Haibo Chen edited comment on YARN-6199 at 6/7/17 4:46 PM: -- The new patch uses

[jira] [Commented] (YARN-6199) Support for listing flows with filter userid

[ https://issues.apache.org/jira/browse/YARN-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16041194#comment-16041194 ] Haibo Chen commented on YARN-6199: -- Will follow up with a patch for YARN-5355 > Support for listing flows

[jira] [Comment Edited] (YARN-6199) Support for listing flows with filter userid

[ https://issues.apache.org/jira/browse/YARN-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16041194#comment-16041194 ] Haibo Chen edited comment on YARN-6199 at 6/7/17 4:47 PM: -- Will follow up with a

[jira] [Commented] (YARN-6199) Support for listing flows with filter userid

[ https://issues.apache.org/jira/browse/YARN-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16040190#comment-16040190 ] Haibo Chen commented on YARN-6199: -- Thanks [~varun_saxena] for your review! I'll update the patch to

[jira] [Updated] (YARN-6199) Support for listing flows with filter userid

[ https://issues.apache.org/jira/browse/YARN-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6199: - Attachment: YARN-6199-YARN-5355.01.patch > Support for listing flows with filter userid >

[jira] [Commented] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16041240#comment-16041240 ] Haibo Chen commented on YARN-6670: -- Compilation failed because of web ui. Will retrigger the jenkins job.

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1 in REST output

[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033262#comment-16033262 ] Haibo Chen commented on YARN-5094: -- As indicated in the comments above, YARN-5169 is the real cause. I am

[jira] [Commented] (YARN-6047) Documentation updates for TimelineService v2

[ https://issues.apache.org/jira/browse/YARN-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033291#comment-16033291 ] Haibo Chen commented on YARN-6047: -- Linked YARN-6323 to document the first-time rolling upgrade case. >

[jira] [Reopened] (YARN-6670) Add over-allocation thresholds to allow per-node oversubscription

[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reopened YARN-6670: -- Reopen to add separate thresholds for CPU and memory over allocation > Add over-allocation thresholds to

[jira] [Created] (YARN-6677) Pause and preempt containers when root container cgroup goes over memory limit

Haibo Chen created YARN-6677: Summary: Pause and preempt containers when root container cgroup goes over memory limit Key: YARN-6677 URL: https://issues.apache.org/jira/browse/YARN-6677 Project: Hadoop

[jira] [Updated] (YARN-6677) Pause and preempt containers when root container cgroup goes over memory limit

[ https://issues.apache.org/jira/browse/YARN-6677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6677: - Issue Type: Sub-task (was: Bug) Parent: YARN-1011 > Pause and preempt containers when root

[jira] [Updated] (YARN-6670) Add separate configurations for cpu and memory oversubscription

[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6670: - Summary: Add separate configurations for cpu and memory oversubscription (was: Add over-allocation

[jira] [Resolved] (YARN-6670) Add over-allocation thresholds to allow per-node oversubscription

[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-6670. -- Resolution: Duplicate > Add over-allocation thresholds to allow per-node oversubscription >

[jira] [Updated] (YARN-6199) Support for listing flows with filter userid

[ https://issues.apache.org/jira/browse/YARN-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6199: - Attachment: YARN-6199.00.patch Uploading a preliminary patch. I have also tested it with REST API. A known

[jira] [Commented] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16039831#comment-16039831 ] Haibo Chen commented on YARN-6670: -- The patch is updated to address 1) and 2). In cases where the

[jira] [Updated] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6670: - Attachment: YARN-6670-YARN-1011.02.patch > Add separate NM overallocation thresholds for cpu and memory >

[jira] [Commented] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045570#comment-16045570 ] Haibo Chen commented on YARN-6670: -- [~miklos.szeg...@cloudera.com] NM_OVERALLOCATION_GENERAL_THRESHOLD

[jira] [Commented] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045571#comment-16045571 ] Haibo Chen commented on YARN-6670: -- To move things forward, maybe we could continue the discussion of your

[jira] [Commented] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045568#comment-16045568 ] Haibo Chen commented on YARN-6670: -- Thanks [~kkaranasos] for the review! I will update the patch to

[jira] [Updated] (YARN-6705) Add separate NM preemption thresholds for cpu and memory

[ https://issues.apache.org/jira/browse/YARN-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6705: - Issue Type: Sub-task (was: Task) Parent: YARN-1011 > Add separate NM preemption thresholds for

[jira] [Updated] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6670: - Attachment: YARN-6670-YARN-1011.04.patch > Add separate NM overallocation thresholds for cpu and memory >

[jira] [Updated] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6670: - Attachment: YARN-6670-YARN-1011.05.patch > Add separate NM overallocation thresholds for cpu and memory >

[jira] [Updated] (YARN-6199) Support for listing flows with filter userid

[ https://issues.apache.org/jira/browse/YARN-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6199: - Attachment: YARN-6199.02.patch Updated the patch against trunk to address the checkstyle issue. >

[jira] [Updated] (YARN-6563) ConcurrentModificationException in TimelineCollectorManager while stopping RM

[ https://issues.apache.org/jira/browse/YARN-6563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6563: - Issue Type: Sub-task (was: Bug) Parent: YARN-5355 > ConcurrentModificationException in

[jira] [Updated] (YARN-6563) ConcurrentModificationException in TimelineCollectorManager while stopping RM

[ https://issues.apache.org/jira/browse/YARN-6563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6563: - Attachment: YARN-6563.00.patch > ConcurrentModificationException in TimelineCollectorManager while

[jira] [Commented] (YARN-6559) Findbugs warning in YARN-5355 branch

[ https://issues.apache.org/jira/browse/YARN-6559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1640#comment-1640 ] Haibo Chen commented on YARN-6559: -- No idea why findbugs is still complaining about the warning that the

[jira] [Commented] (YARN-6457) Allow custom SSL configuration to be supplied in WebApps

[ https://issues.apache.org/jira/browse/YARN-6457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16000107#comment-16000107 ] Haibo Chen commented on YARN-6457: -- [~PramodSSImmaneni], [~sanjaypujare], the approach looks great to me!

[jira] [Commented] (YARN-6555) Enable flow context read (& corresponding write) for recovering application with NM restart

[ https://issues.apache.org/jira/browse/YARN-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1636#comment-1636 ] Haibo Chen commented on YARN-6555: -- I remember vaguely that this is the issue that Li came across in

[jira] [Commented] (YARN-6563) ConcurrentModificationException in TimelineCollectorManager while stopping RM

[ https://issues.apache.org/jira/browse/YARN-6563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1628#comment-1628 ] Haibo Chen commented on YARN-6563: -- Looks like we need to synchronize on the collectors object, per

[jira] [Comment Edited] (YARN-6563) ConcurrentModificationException in TimelineCollectorManager while stopping RM

[ https://issues.apache.org/jira/browse/YARN-6563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1628#comment-1628 ] Haibo Chen edited comment on YARN-6563 at 5/7/17 7:57 PM: -- Looks like we need to

[jira] [Assigned] (YARN-6563) ConcurrentModificationException in TimelineCollectorManager while stopping RM

[ https://issues.apache.org/jira/browse/YARN-6563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-6563: Assignee: Haibo Chen > ConcurrentModificationException in TimelineCollectorManager while stopping

[jira] [Commented] (YARN-5067) Support specifying resources for AM containers in SLS

[ https://issues.apache.org/jira/browse/YARN-5067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16000239#comment-16000239 ] Haibo Chen commented on YARN-5067: -- Thanks [~yufeigu] for the patch! A few high-level comments. 1) Why

[jira] [Commented] (YARN-6457) Allow custom SSL configuration to be supplied in WebApps

[ https://issues.apache.org/jira/browse/YARN-6457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001333#comment-16001333 ] Haibo Chen commented on YARN-6457: -- If it is convenient for you, you can generate a patch (name it to

[jira] [Commented] (YARN-6457) Allow custom SSL configuration to be supplied in WebApps

[ https://issues.apache.org/jira/browse/YARN-6457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001330#comment-16001330 ] Haibo Chen commented on YARN-6457: -- The findbugs warnings are not related. Mind fixing the javadoc issue?

[jira] [Updated] (YARN-6457) Allow custom SSL configuration to be supplied in WebApps

[ https://issues.apache.org/jira/browse/YARN-6457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6457: - Attachment: YARN-6457.00.patch Attaching a patch from the Pull Request to initiate pre-commit check on the

[jira] [Commented] (YARN-6457) Allow custom SSL configuration to be supplied in WebApps

[ https://issues.apache.org/jira/browse/YARN-6457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001721#comment-16001721 ] Haibo Chen commented on YARN-6457: -- [~sanjaypujare], can you go to YARN-4562 to request a backport of it,

[jira] [Commented] (YARN-6457) Allow custom SSL configuration to be supplied in WebApps

[ https://issues.apache.org/jira/browse/YARN-6457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001667#comment-16001667 ] Haibo Chen commented on YARN-6457: -- Patch LGTM+1, will fix the minor checkstyle issue when I commit. >

[jira] [Commented] (YARN-6657) The column family indicated in AppToFlowTable class javadoc is wrong

[ https://issues.apache.org/jira/browse/YARN-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16029768#comment-16029768 ] Haibo Chen commented on YARN-6657: -- Oh, I did not realize that. I guess in this case, no need to get this

[jira] [Commented] (YARN-6628) Unexpected jackson-core-2.2.3 dependency introduced

[ https://issues.apache.org/jira/browse/YARN-6628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018113#comment-16018113 ] Haibo Chen commented on YARN-6628: -- Based on its pom file, fst depends on jackson-core:2.8.8 {code:xml}

[jira] [Commented] (YARN-6628) Unexpected jackson-core-2.2.3 dependency introduced

[ https://issues.apache.org/jira/browse/YARN-6628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018133#comment-16018133 ] Haibo Chen commented on YARN-6628: -- Similar for jackson-core-asl, it shows up in the dependency tree in

[jira] [Created] (YARN-6670) Add a new configuration, over-allocation threshold, to allow per-node oversubscription

Haibo Chen created YARN-6670: Summary: Add a new configuration, over-allocation threshold, to allow per-node oversubscription Key: YARN-6670 URL: https://issues.apache.org/jira/browse/YARN-6670 Project:

[jira] [Commented] (YARN-6323) Rolling upgrade/config change is broken on timeline v2.

[ https://issues.apache.org/jira/browse/YARN-6323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16032185#comment-16032185 ] Haibo Chen commented on YARN-6323: -- In rolling upgrade cases where the newer version of YARN cluster has

[jira] [Updated] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6670: - Attachment: YARN-6670-YARN-1011.01.patch > Add separate NM overallocation thresholds for cpu and memory >

[jira] [Updated] (YARN-6690) Consolidate NM overallocation thresholds with ResourceTypes

[ https://issues.apache.org/jira/browse/YARN-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6690: - Issue Type: Sub-task (was: Improvement) Parent: YARN-1011 > Consolidate NM overallocation

[jira] [Created] (YARN-6690) Consolidate NM overallocation thresholds with ResourceTypes

Haibo Chen created YARN-6690: Summary: Consolidate NM overallocation thresholds with ResourceTypes Key: YARN-6690 URL: https://issues.apache.org/jira/browse/YARN-6690 Project: Hadoop YARN

[jira] [Commented] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16037483#comment-16037483 ] Haibo Chen commented on YARN-6670: -- Thanks [~kasha] for your review ! In ResourceTypes, a new class,

<    3   4   5   6   7   8   9   10   11   12   >