[jira] [Commented] (YARN-7835) [Atsv2] Race condition in NM while publishing events if second attempt launched on same node

2018-02-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16372827#comment-16372827 ] Haibo Chen commented on YARN-7835: -- +1 LGTM > [Atsv2] Race condition in NM while publishi

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 beta release

2018-02-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16372432#comment-16372432 ] Haibo Chen commented on YARN-7346: -- Attached a patch that builds on top of Rohith's increm

[jira] [Updated] (YARN-7346) Fix compilation errors against hbase2 beta release

2018-02-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7346: - Attachment: YARN-7346.05.patch > Fix compilation errors against hbase2 beta release > -

[jira] [Commented] (YARN-7835) [Atsv2] Race condition in NM while publishing events if second attempt launched on same node

2018-02-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16372404#comment-16372404 ] Haibo Chen commented on YARN-7835: -- Thanks [~rohithsharma] for  the updated patch! There a

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 beta release

2018-02-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370728#comment-16370728 ] Haibo Chen commented on YARN-7346: -- +1 on option 2. But I am not sure how to pull in two v

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 beta release

2018-02-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370520#comment-16370520 ] Haibo Chen commented on YARN-7346: -- {quote}Looking into timelinservice-hbase-* code, it ac

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 beta release

2018-02-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370169#comment-16370169 ] Haibo Chen commented on YARN-7346: -- Thanks [~rohithsharma] for the review! I cannot seem t

[jira] [Comment Edited] (YARN-7346) Fix compilation errors against hbase2 beta release

2018-02-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369475#comment-16369475 ] Haibo Chen edited comment on YARN-7346 at 2/19/18 8:20 PM: --- Looks

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 beta release

2018-02-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369475#comment-16369475 ] Haibo Chen commented on YARN-7346: -- Looks like maven still tries to compile hbase-server-2

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 beta release

2018-02-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369298#comment-16369298 ] Haibo Chen commented on YARN-7346: -- Thanks [~rohithsharma] for the incremental patch! Let'

[jira] [Updated] (YARN-7346) Fix compilation errors against hbase2 beta release

2018-02-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7346: - Attachment: YARN-7346.04.patch > Fix compilation errors against hbase2 beta release > -

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 beta release

2018-02-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368732#comment-16368732 ] Haibo Chen commented on YARN-7346: -- Even though the profile that triggers timelineservice-

[jira] [Updated] (YARN-7346) Fix compilation errors against hbase2 beta release

2018-02-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7346: - Attachment: YARN-7346.03.patch > Fix compilation errors against hbase2 beta release > -

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 beta release

2018-02-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368608#comment-16368608 ] Haibo Chen commented on YARN-7346: -- Uploaded a patch to does the conditional compilation b

[jira] [Updated] (YARN-7346) Fix compilation errors against hbase2 beta release

2018-02-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7346: - Attachment: YARN-7346.02.patch > Fix compilation errors against hbase2 beta release > -

[jira] [Updated] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7919: - Attachment: YARN-7919-branch-2.05.patch > Split timelineservice-hbase module to make YARN-7346 easier > ---

[jira] [Commented] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368221#comment-16368221 ] Haibo Chen commented on YARN-7919: -- I will work on a branch-2 patch in the meantime and up

[jira] [Commented] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368220#comment-16368220 ] Haibo Chen commented on YARN-7919: -- Thanks [~rohithsharma] for the review and debugging, I

[jira] [Updated] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7919: - Attachment: YARN-7919.05.patch > Split timelineservice-hbase module to make YARN-7346 easier >

[jira] [Commented] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16367769#comment-16367769 ] Haibo Chen commented on YARN-7919: -- Yes, doing the jcoding fix in YARN-7346 sounds good to

[jira] [Commented] (YARN-7941) Transitive dependencies for component are not resolved

2018-02-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16367678#comment-16367678 ] Haibo Chen commented on YARN-7941: -- [~rohithsharma] Is this a HBase issue or a YARN issue?

[jira] [Commented] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16367669#comment-16367669 ] Haibo Chen commented on YARN-7919: -- YARN currently does not have jcodings as a direct depe

[jira] [Comment Edited] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16367669#comment-16367669 ] Haibo Chen edited comment on YARN-7919 at 2/16/18 6:02 PM: --- YARN

[jira] [Commented] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16367594#comment-16367594 ] Haibo Chen commented on YARN-7919: -- Agreed, [~elserj]. My understanding of why enforcer-pl

[jira] [Comment Edited] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16367485#comment-16367485 ] Haibo Chen edited comment on YARN-7919 at 2/16/18 3:45 PM: --- Good

[jira] [Commented] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16367485#comment-16367485 ] Haibo Chen commented on YARN-7919: -- Good catch, [~rohithsharma]! The jcodings problem is m

[jira] [Updated] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-15 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7919: - Attachment: YARN-7919.04.patch > Split timelineservice-hbase module to make YARN-7346 easier >

[jira] [Updated] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-15 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7919: - Attachment: YARN-7919.03.patch > Split timelineservice-hbase module to make YARN-7346 easier >

[jira] [Updated] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-15 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7919: - Attachment: (was: YARN-7346.03.patch) > Split timelineservice-hbase module to make YARN-7346 easier > -

[jira] [Updated] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-15 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7919: - Attachment: YARN-7346.03.patch > Split timelineservice-hbase module to make YARN-7346 easier >

[jira] [Commented] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364460#comment-16364460 ] Haibo Chen commented on YARN-7919: -- Did you see some source files in the src/ directory? I

[jira] [Assigned] (YARN-6586) YARN to facilitate HTTPS in AM web server

2018-02-13 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-6586: Assignee: (was: Haibo Chen) > YARN to facilitate HTTPS in AM web server > --

[jira] [Assigned] (YARN-4946) RM should write out Aggregated Log Completion file flag next to logs

2018-02-13 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-4946: Assignee: (was: Haibo Chen) > RM should write out Aggregated Log Completion file flag next to lo

[jira] [Updated] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-13 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7919: - Attachment: YARN-7919.02.patch > Split timelineservice-hbase module to make YARN-7346 easier >

[jira] [Updated] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-13 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7919: - Attachment: (was: YARN-7919.02.patch) > Split timelineservice-hbase module to make YARN-7346 easier > -

[jira] [Updated] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-13 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7919: - Attachment: YARN-7919.02.patch > Split timelineservice-hbase module to make YARN-7346 easier >

[jira] [Commented] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-13 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16362746#comment-16362746 ] Haibo Chen commented on YARN-7919: -- Yes, I was working on it with the maven-assembly-plugi

[jira] [Commented] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16361404#comment-16361404 ] Haibo Chen commented on YARN-7919: -- {quote}Given this split is committed, then modificatio

[jira] [Commented] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360868#comment-16360868 ] Haibo Chen commented on YARN-7919: -- The latest patch does not apply to branch-3.1, please

[jira] [Commented] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360839#comment-16360839 ] Haibo Chen commented on YARN-7919: -- I uploaded a new patch for trunk which should address

[jira] [Updated] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7919: - Attachment: YARN-7919.01.patch > Split timelineservice-hbase module to make YARN-7346 easier >

[jira] [Commented] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360830#comment-16360830 ] Haibo Chen commented on YARN-7919: -- Thanks [~rohithsharma] for the quick review!  I believ

[jira] [Updated] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7919: - Attachment: YARN-7919.00.patch > Split timelineservice-hbase module to make YARN-7346 easier >

[jira] [Updated] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7919: - Attachment: (was: YARN-7919.00.patch) > Split timelineservice-hbase module to make YARN-7346 easier > -

[jira] [Updated] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7919: - Attachment: YARN-7919.00.patch > Split timelineservice-hbase module to make YARN-7346 easier >

[jira] [Updated] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7919: - Issue Type: Sub-task (was: Improvement) Parent: YARN-7213 > Split timelineservice-hbase module to

[jira] [Created] (YARN-7919) Split timelineservice-hbase module to make YARN-7346 easier

2018-02-10 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7919: Summary: Split timelineservice-hbase module to make YARN-7346 easier Key: YARN-7919 URL: https://issues.apache.org/jira/browse/YARN-7919 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7835) [Atsv2] Race condition in NM while publishing events if second attempt launched on same node

2018-02-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16357463#comment-16357463 ] Haibo Chen commented on YARN-7835: -- Thanks for the patch [~rohithsharma]. A few comments:

[jira] [Updated] (YARN-6675) Add NM support to launch opportunistic containers based on overallocation

2018-02-06 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6675: - Attachment: YARN-6675-YARN-1011.prelim1.patch > Add NM support to launch opportunistic containers based on

[jira] [Updated] (YARN-6675) Add NM support to launch opportunistic containers based on overallocation

2018-02-06 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6675: - Attachment: (was: YARN-6675-YARN-1011.prelim0.patch) > Add NM support to launch opportunistic container

[jira] [Updated] (YARN-6675) Add NM support to launch opportunistic containers based on overallocation

2018-02-06 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6675: - Attachment: YARN-6675-YARN-1011.prelim0.patch > Add NM support to launch opportunistic containers based on

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 beta release

2018-02-06 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16354067#comment-16354067 ] Haibo Chen commented on YARN-7346: -- [~vrushalic] Have you got a chance to look at YARN-498

[jira] [Updated] (YARN-6739) Crash NM at start time if oversubscription is on but LinuxContainerExcutor or cgroup is off

2018-02-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6739: - Attachment: YARN-6739-YARN-1011.01.patch > Crash NM at start time if oversubscription is on but LinuxContai

[jira] [Commented] (YARN-6739) Crash NM at start time if oversubscription is on but LinuxContainerExcutor or cgroup is off

2018-02-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352443#comment-16352443 ] Haibo Chen commented on YARN-6739: -- Thanks [~miklos.szeg...@cloudera.com] for the catch! I

[jira] [Created] (YARN-7888) container-log4j.properties is in hadoop-yarn-node-manager.jar

2018-02-02 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7888: Summary: container-log4j.properties is in hadoop-yarn-node-manager.jar Key: YARN-7888 URL: https://issues.apache.org/jira/browse/YARN-7888 Project: Hadoop YARN Issu

[jira] [Commented] (YARN-7819) Allow PlacementProcessor to be used with the FairScheduler

2018-01-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16347818#comment-16347818 ] Haibo Chen commented on YARN-7819: -- Thanks [~asuresh] for the patch. I took a quick look a

[jira] [Updated] (YARN-6578) Return container resource utilization from NM ContainerStatus call

2018-01-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6578: - Issue Type: Improvement (was: New Feature) > Return container resource utilization from NM ContainerStatus

[jira] [Commented] (YARN-5907) [Umbrella] [YARN-1042] add ability to specify affinity/anti-affinity in container requests

2018-01-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16347787#comment-16347787 ] Haibo Chen commented on YARN-5907: -- [~leftnoteasy] While reading YARN-6592, I wonder if th

[jira] [Commented] (YARN-7835) [Atsv2] Race condition in NM while publishing events if second attempt launched on same node

2018-01-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16347584#comment-16347584 ] Haibo Chen commented on YARN-7835: -- Thanks [~rohithsharma] for the clarification! I agree

[jira] [Resolved] (YARN-7837) TestRMWebServiceAppsNodelabel.testAppsRunning is failing

2018-01-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-7837. -- Resolution: Duplicate > TestRMWebServiceAppsNodelabel.testAppsRunning is failing > --

[jira] [Resolved] (YARN-7852) FlowRunReader constructs min_start_time filter for both createdtimestart and createdtimeend.

2018-01-30 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-7852. -- Resolution: Invalid > FlowRunReader constructs min_start_time filter for both createdtimestart and > cre

[jira] [Updated] (YARN-7852) FlowRunReader constructs min_start_time filter for both createdtimestart and createdtimeend.

2018-01-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7852: - Issue Type: Sub-task (was: Bug) Parent: YARN-7055 > FlowRunReader constructs min_start_time filter

[jira] [Updated] (YARN-7852) FlowRunReader constructs min_start_time filter for both createdtimestart and createdtimeend.

2018-01-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7852: - Description: {code:java} protected FilterList constructFilterListBasedOnFilters() throws IOException {    

[jira] [Created] (YARN-7852) FlowRunReader constructs min_start_time filter for both createdtimestart and createdtimeend.

2018-01-29 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7852: Summary: FlowRunReader constructs min_start_time filter for both createdtimestart and createdtimeend. Key: YARN-7852 URL: https://issues.apache.org/jira/browse/YARN-7852 Proj

[jira] [Commented] (YARN-7835) [Atsv2] Race condition in NM while publishing events if second attempt launched on same node

2018-01-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343871#comment-16343871 ] Haibo Chen commented on YARN-7835: -- [~rohithsharma] Trying to understand the issue here. I

[jira] [Updated] (YARN-6675) Add NM support to launch opportunistic containers based on overallocation

2018-01-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6675: - Attachment: YARN-6675-YARN-1011.prelim0.patch > Add NM support to launch opportunistic containers based on

[jira] [Updated] (YARN-6739) Crash NM at start time if oversubscription is on but LinuxContainerExcutor or cgroup is off

2018-01-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6739: - Attachment: YARN-6739-YARN-1011.00.patch > Crash NM at start time if oversubscription is on but LinuxContai

[jira] [Commented] (YARN-7837) TestRMWebServiceAppsNodelabel.testAppsRunning is failing

2018-01-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16342661#comment-16342661 ] Haibo Chen commented on YARN-7837: -- CC [~wangda] [~sunilg] > TestRMWebServiceAppsNodelabe

[jira] [Created] (YARN-7837) TestRMWebServiceAppsNodelabel.testAppsRunning is failing

2018-01-28 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7837: Summary: TestRMWebServiceAppsNodelabel.testAppsRunning is failing Key: YARN-7837 URL: https://issues.apache.org/jira/browse/YARN-7837 Project: Hadoop YARN Issue Type

[jira] [Updated] (YARN-7837) TestRMWebServiceAppsNodelabel.testAppsRunning is failing

2018-01-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7837: - Description: org.junit.ComparisonFailure: partition amused Expected :\{"memory":1024,"vCores":1} Actual 

[jira] [Updated] (YARN-7064) Use cgroup to get container resource utilization

2018-01-26 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7064: - Component/s: nodemanager > Use cgroup to get container resource utilization > -

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2018-01-26 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16341938#comment-16341938 ] Haibo Chen commented on YARN-7064: -- The findbug issue and unit test failure are unrelated.

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2018-01-26 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16341845#comment-16341845 ] Haibo Chen commented on YARN-7064: -- +1 pending Jenkins. > Use cgroup to get container res

[jira] [Updated] (YARN-7806) Distributed Shell should use timeline async api's

2018-01-24 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7806: - Component/s: distributed-shell > Distributed Shell should use timeline async api's > --

[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16337037#comment-16337037 ] Haibo Chen commented on YARN-5473: -- Thanks [~miklos.szeg...@cloudera.com] for the reviews!

[jira] [Updated] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5473: - Attachment: YARN-5473-YARN-1011.04.patch > Expose per-application over-allocation info in the Resource Mana

[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16336624#comment-16336624 ] Haibo Chen commented on YARN-5473: -- I'll update the patch again to address the two TestCon

[jira] [Updated] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5473: - Attachment: YARN-5473-YARN-1011.03.patch > Expose per-application over-allocation info in the Resource Mana

[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16336182#comment-16336182 ] Haibo Chen commented on YARN-5473: -- Update the patch to address the reported checkstyle is

[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16335482#comment-16335482 ] Haibo Chen commented on YARN-5473: -- I kicked off another Jenkins run. The findbug warning

[jira] [Updated] (YARN-6794) Fair Scheduler to explicitly promote OPPORTUNISITIC containers locally at the node where they're running

2018-01-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6794: - Summary: Fair Scheduler to explicitly promote OPPORTUNISITIC containers locally at the node where they're r

[jira] [Updated] (YARN-6794) FS to explicitly promote OPPORTUNISITIC containers locally at the node where they're running

2018-01-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6794: - Summary: FS to explicitly promote OPPORTUNISITIC containers locally at the node where they're running (was

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2018-01-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16335244#comment-16335244 ] Haibo Chen commented on YARN-7064: -- The latest patch does not apply any more to trunk > U

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2018-01-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16335189#comment-16335189 ] Haibo Chen commented on YARN-7064: -- I see. Let's leave it for now then, we can always fix

[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332963#comment-16332963 ] Haibo Chen commented on YARN-5473: -- Thanks [~snemeth] for the review! For 1) and 2), given

[jira] [Updated] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5473: - Attachment: YARN-5473-YARN-1011.02.patch > Expose per-application over-allocation info in the Resource Mana

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

2018-01-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332604#comment-16332604 ] Haibo Chen commented on YARN-5094: -- Thanks [~rohithsharma] for the review. Will commit it

[jira] [Comment Edited] (YARN-5094) some YARN container events have timestamp of -1

2018-01-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332482#comment-16332482 ] Haibo Chen edited comment on YARN-5094 at 1/19/18 4:13 PM: --- +1 on

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

2018-01-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332482#comment-16332482 ] Haibo Chen commented on YARN-5094: -- +1 on fixing it. [~rohithsharma] [~sunilg] [~vrushalic

[jira] [Commented] (YARN-7765) [Atsv2] App collector failed to authenticate with HBase in secure cluster

2018-01-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16328802#comment-16328802 ] Haibo Chen commented on YARN-7765: -- FYI, We have not observed the same issue internally in

[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16328063#comment-16328063 ] Haibo Chen commented on YARN-5473: -- The unit test failure is MAPREDUCE-7020. Findbug is un

[jira] [Commented] (YARN-7748) TestContainerResizing.testIncreaseContainerUnreservedWhenApplicationCompleted failed

2018-01-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16325654#comment-16325654 ] Haibo Chen commented on YARN-7748: -- I suspect the failure has something to with more than

[jira] [Commented] (YARN-7748) TestContainerResizing.testIncreaseContainerUnreservedWhenApplicationCompleted failed

2018-01-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16325652#comment-16325652 ] Haibo Chen commented on YARN-7748: -- {code} 2018-01-14 09:45:15,849 DEBUG [main] service.Ab

[jira] [Created] (YARN-7748) TestContainerResizing.testIncreaseContainerUnreservedWhenApplicationCompleted failed

2018-01-14 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7748: Summary: TestContainerResizing.testIncreaseContainerUnreservedWhenApplicationCompleted failed Key: YARN-7748 URL: https://issues.apache.org/jira/browse/YARN-7748 Project: Ha

[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16325649#comment-16325649 ] Haibo Chen commented on YARN-5473: -- Updated the patch to address the new findbug issues as

[jira] [Updated] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5473: - Attachment: YARN-5473-YARN-1011.01.patch > Expose per-application over-allocation info in the Resource Mana

[jira] [Updated] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-13 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5473: - Attachment: YARN-5473-YARN-1011.00.patch > Expose per-application over-allocation info in the Resource Mana

[jira] [Updated] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5473: - Attachment: YARN-5473-YARN-1011.prelim.patch Attaching a preliminary patch for initial Jenkins report. > E

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2018-01-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16324221#comment-16324221 ] Haibo Chen commented on YARN-7064: -- bq. I think the logging inside isAvailable should be e

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2018-01-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16323135#comment-16323135 ] Haibo Chen commented on YARN-7064: -- Thanks [~miklos.szeg...@cloudera.com] for the update!

<    3   4   5   6   7   8   9   10   11   12   >