[jira] [Commented] (YARN-5354) TestDistributedShell.checkTimelineV2() may fail for concurrent tests

2016-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372194#comment-15372194 ] Hadoop QA commented on YARN-5354: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5354) TestDistributedShell.checkTimelineV2() may fail for concurrent tests

2016-07-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5354: -- Attachment: YARN-5354.03.patch Posted patch v.3. Removed code that deletes the directory. >

[jira] [Commented] (YARN-5354) TestDistributedShell.checkTimelineV2() may fail for concurrent tests

2016-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372161#comment-15372161 ] Hadoop QA commented on YARN-5354: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5354) TestDistributedShell.checkTimelineV2() may fail for concurrent tests

2016-07-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5354: -- Attachment: YARN-5354.02.patch That's a good suggestion. I've updated the patch to use

[jira] [Issue Comment Deleted] (YARN-5287) LinuxContainerExecutor fails to set proper permission

2016-07-11 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ying Zhang updated YARN-5287: - Comment: was deleted (was: I have a simple patch here. I've tested it with my 3-node cluster. It works as

[jira] [Commented] (YARN-5287) LinuxContainerExecutor fails to set proper permission

2016-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372119#comment-15372119 ] Hadoop QA commented on YARN-5287: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5287) LinuxContainerExecutor fails to set proper permission

2016-07-11 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ying Zhang updated YARN-5287: - Attachment: YARN-5287.001.patch > LinuxContainerExecutor fails to set proper permission >

[jira] [Commented] (YARN-5287) LinuxContainerExecutor fails to set proper permission

2016-07-11 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372083#comment-15372083 ] Ying Zhang commented on YARN-5287: -- I have a simple patch here. I've tested it with my 3-node cluster. It

[jira] [Commented] (YARN-5287) LinuxContainerExecutor fails to set proper permission

2016-07-11 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372080#comment-15372080 ] Ying Zhang commented on YARN-5287: -- Way to reproduce: 1. configure the cluster with umask 077 for all

[jira] [Updated] (YARN-5287) LinuxContainerExecutor fails to set proper permission

2016-07-11 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ying Zhang updated YARN-5287: - Description: LinuxContainerExecutor fails to set the proper permissions on the local directories(i.e.,

[jira] [Commented] (YARN-5265) Make HBase configuration for the timeline service configurable

2016-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372061#comment-15372061 ] Hadoop QA commented on YARN-5265: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5354) TestDistributedShell.checkTimelineV2() may fail for concurrent tests

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372027#comment-15372027 ] Joep Rottinghuis commented on YARN-5354: This should work, but why not use {code} @Rule public

[jira] [Commented] (YARN-5200) Improve yarn logs to get Container List

2016-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372022#comment-15372022 ] Hadoop QA commented on YARN-5200: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5265) Make HBase configuration for the timeline service configurable

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5265: --- Attachment: YARN-5265-YARN-5355.06.patch Path on new branch YARN-5355 with findbugs and

[jira] [Updated] (YARN-5200) Improve yarn logs to get Container List

2016-07-11 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5200: Attachment: YARN-5200.9.patch > Improve yarn logs to get Container List >

[jira] [Commented] (YARN-5200) Improve yarn logs to get Container List

2016-07-11 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371973#comment-15371973 ] Xuan Gong commented on YARN-5200: - Thanks for the review. bq. The following incorrectly shows information

[jira] [Commented] (YARN-5179) Issue of CPU usage of containers

2016-07-11 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371957#comment-15371957 ] Inigo Goiri commented on YARN-5179: --- [~asuresh], given that YARN-5117 acknowledges that there is a

[jira] [Comment Edited] (YARN-5356) ResourceUtilization should also include resource availability

2016-07-11 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371947#comment-15371947 ] Inigo Goiri edited comment on YARN-5356 at 7/12/16 12:15 AM: - In general, we

[jira] [Commented] (YARN-5356) ResourceUtilization should also include resource availability

2016-07-11 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371947#comment-15371947 ] Inigo Goiri commented on YARN-5356: --- In general, we have 3 values: * Actual resources of the full

[jira] [Commented] (YARN-5280) Allow YARN containers to run with Java Security Manager

2016-07-11 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371815#comment-15371815 ] Larry McCay commented on YARN-5280: --- bq. In order to prevent users from granting themselves excess

[jira] [Commented] (YARN-5354) TestDistributedShell.checkTimelineV2() may fail for concurrent tests

2016-07-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371770#comment-15371770 ] Sangjin Lee commented on YARN-5354: --- I would greatly appreciate your review. Thanks! >

[jira] [Commented] (YARN-5354) TestDistributedShell.checkTimelineV2() may fail for concurrent tests

2016-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371763#comment-15371763 ] Hadoop QA commented on YARN-5354: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5354) TestDistributedShell.checkTimelineV2() may fail for concurrent tests

2016-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371756#comment-15371756 ] Hadoop QA commented on YARN-5354: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5270) Solve miscellaneous issues caused by YARN-4844

2016-07-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371728#comment-15371728 ] Jian He commented on YARN-5270: --- lgtm, +1 > Solve miscellaneous issues caused by YARN-4844 >

[jira] [Commented] (YARN-5359) FileSystemTimelineReader/Writer uses unix-specific default

2016-07-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371702#comment-15371702 ] Sangjin Lee commented on YARN-5359: --- I'll get to this after YARN-5354 and MAPREDUCE-6731 are committed.

[jira] [Created] (YARN-5359) FileSystemTimelineReader/Writer uses unix-specific default

2016-07-11 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5359: - Summary: FileSystemTimelineReader/Writer uses unix-specific default Key: YARN-5359 URL: https://issues.apache.org/jira/browse/YARN-5359 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-5354) TestDistributedShell.checkTimelineV2() may fail for concurrent tests

2016-07-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5354: -- Attachment: YARN-5354.01.patch Posted patch v.1. Switched to using a test-specific storage directory. I

[jira] [Updated] (YARN-5354) TestDistributedShell.checkTimelineV2() may fail for concurrent tests

2016-07-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5354: -- Description: {{TestDistributedShell.checkTimelineV2()}} uses the default (hard-coded) storage root

[jira] [Commented] (YARN-5353) ResourceManager can leak delegation tokens when they are shared across apps

2016-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371680#comment-15371680 ] Hadoop QA commented on YARN-5353: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5080) Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM

2016-07-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371632#comment-15371632 ] Junping Du commented on YARN-5080: -- Addendum patch looks good to me. +1. Will commit it tomorrow if no

[jira] [Assigned] (YARN-5358) Consider adding a config setting to accept cluster name

2016-07-11 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C reassigned YARN-5358: Assignee: Vrushali C > Consider adding a config setting to accept cluster name >

[jira] [Created] (YARN-5358) Consider adding a config setting to accept cluster name

2016-07-11 Thread Vrushali C (JIRA)
Vrushali C created YARN-5358: Summary: Consider adding a config setting to accept cluster name Key: YARN-5358 URL: https://issues.apache.org/jira/browse/YARN-5358 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-5357) Timeline service v2 integration with Federation

2016-07-11 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5357: - Description: Jira to note the discussion points from an initial chat about integrating Timeline Service

[jira] [Created] (YARN-5357) Timeline service v2 integration with Federation

2016-07-11 Thread Vrushali C (JIRA)
Vrushali C created YARN-5357: Summary: Timeline service v2 integration with Federation Key: YARN-5357 URL: https://issues.apache.org/jira/browse/YARN-5357 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-5353) ResourceManager can leak delegation tokens when they are shared across apps

2016-07-11 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-5353: - Attachment: YARN-5353.001.patch Seems to me that we need to make sure that the appTokens map always has

[jira] [Commented] (YARN-5280) Allow YARN containers to run with Java Security Manager

2016-07-11 Thread Greg Phillips (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371530#comment-15371530 ] Greg Phillips commented on YARN-5280: - Hello [~lmccay] - Thanks for the link to the EE specification

[jira] [Commented] (YARN-5283) Refactor container assignment into AbstractYarnScheduler#assignContainers

2016-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371482#comment-15371482 ] Hadoop QA commented on YARN-5283: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5355) YARN Timeline Service v.2: alpha 2

2016-07-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371425#comment-15371425 ] Sangjin Lee commented on YARN-5355: --- I have just created and pushed branches {{YARN-5355}} and

[jira] [Updated] (YARN-5355) YARN Timeline Service v.2: alpha 2

2016-07-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5355: -- Description: This is an umbrella JIRA for the alpha 2 milestone for YARN Timeline Service v.2. This is

[jira] [Updated] (YARN-5355) YARN Timeline Service v.2: alpha 2

2016-07-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5355: -- Attachment: Timeline Service v2_ Ideas for Next Steps.pdf > YARN Timeline Service v.2: alpha 2 >

[jira] [Updated] (YARN-5283) Refactor container assignment into AbstractYarnScheduler#assignContainers

2016-07-11 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5283: - Attachment: YARN-5283.002.patch Accidentally included another patch in the same tree. > Refactor

[jira] [Commented] (YARN-5265) Make HBase configuration for the timeline service configurable

2016-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371331#comment-15371331 ] Hadoop QA commented on YARN-5265: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5283) Refactor container assignment into AbstractYarnScheduler#assignContainers

2016-07-11 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371328#comment-15371328 ] Ray Chiang commented on YARN-5283: -- [~subru], sanity checks like {{isReadyToAssignContainers}} are bad for

[jira] [Updated] (YARN-4765) Split TestHBaseTimelineStorage into multiple test classes

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4765: --- Parent Issue: YARN-5355 (was: YARN-2928) > Split TestHBaseTimelineStorage into multiple test

[jira] [Comment Edited] (YARN-4455) Support fetching metrics by time range

2016-07-11 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371311#comment-15371311 ] Varun Saxena edited comment on YARN-4455 at 7/11/16 6:09 PM: - [~jrottinghuis]

[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2016-07-11 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371311#comment-15371311 ] Varun Saxena commented on YARN-4455: [~jrottinghuis] This is to fetch metrics in a time series within a

[jira] [Updated] (YARN-5265) Make HBase configuration for the timeline service configurable

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5265: --- Parent Issue: YARN-5355 (was: YARN-2928) > Make HBase configuration for the timeline service

[jira] [Updated] (YARN-5094) some YARN container events have timestamp of -1 in REST output

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5094: --- Parent Issue: YARN-5355 (was: YARN-2928) > some YARN container events have timestamp of -1 in

[jira] [Updated] (YARN-5156) YARN_CONTAINER_FINISHED of YARN_CONTAINERs will always have running state

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5156: --- Parent Issue: YARN-5355 (was: YARN-2928) > YARN_CONTAINER_FINISHED of YARN_CONTAINERs will

[jira] [Updated] (YARN-5260) Review / Recommendations for hbase writer code

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5260: --- Parent Issue: YARN-5355 (was: YARN-2928) > Review / Recommendations for hbase writer code >

[jira] [Updated] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5229: --- Parent Issue: YARN-5355 (was: YARN-2928) > Refactor #isApplicationEntity and

[jira] [Updated] (YARN-5071) address HBase compatibility issues with trunk

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5071: --- Parent Issue: YARN-5355 (was: YARN-2928) > address HBase compatibility issues with trunk >

[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371287#comment-15371287 ] Joep Rottinghuis commented on YARN-4455: Note quite clear what is mean by this jira.

[jira] [Updated] (YARN-4985) Refactor the coprocessor code & other definition classes into independent packages

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4985: --- Parent Issue: YARN-5355 (was: YARN-2928) > Refactor the coprocessor code & other definition

[jira] [Updated] (YARN-5011) Support metric filters for flow runs

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5011: --- Parent Issue: YARN-5355 (was: YARN-2928) > Support metric filters for flow runs >

[jira] [Updated] (YARN-4786) Enhance hbase coprocessor aggregation operations:GLOBAL_MIN, LATEST_MIN etc and FINAL attributes

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4786: --- Parent Issue: YARN-5355 (was: YARN-2928) > Enhance hbase coprocessor aggregation

[jira] [Updated] (YARN-4821) Have a separate NM timeline publishing-interval

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4821: --- Parent Issue: YARN-5355 (was: YARN-2928) > Have a separate NM timeline publishing-interval >

[jira] [Updated] (YARN-4736) Issues with HBaseTimelineWriterImpl in single node hadoop & hbase cluster

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4736: --- Parent Issue: YARN-5355 (was: YARN-2928) > Issues with HBaseTimelineWriterImpl in single node

[jira] [Updated] (YARN-4504) Retrospect on defaults for created time while querying

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4504: --- Parent Issue: YARN-5355 (was: YARN-2928) > Retrospect on defaults for created time while

[jira] [Updated] (YARN-4675) Reorganize TimeClientImpl into TimeClientV1Impl and TimeClientV2Impl

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4675: --- Parent Issue: YARN-5355 (was: YARN-2928) > Reorganize TimeClientImpl into TimeClientV1Impl

[jira] [Updated] (YARN-4561) Compaction coprocessor enhancements: On/Off, whitelisting, blacklisting

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4561: --- Parent Issue: YARN-5355 (was: YARN-2928) > Compaction coprocessor enhancements: On/Off,

[jira] [Commented] (YARN-4489) Limit flow runs returned while querying flows

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371295#comment-15371295 ] Joep Rottinghuis commented on YARN-4489: Don't we already have this in alpha-1? > Limit flow runs

[jira] [Updated] (YARN-4455) Support fetching metrics by time range

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4455: --- Parent Issue: YARN-5355 (was: YARN-2928) > Support fetching metrics by time range >

[jira] [Updated] (YARN-4343) Need to support Application History Server on ATSV2

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4343: --- Parent Issue: YARN-5355 (was: YARN-2928) > Need to support Application History Server on

[jira] [Updated] (YARN-4368) Support Multiple versions of the timeline service at the same time

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4368: --- Parent Issue: YARN-5355 (was: YARN-2928) > Support Multiple versions of the timeline service

[jira] [Updated] (YARN-4489) Limit flow runs returned while querying flows

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4489: --- Parent Issue: YARN-5355 (was: YARN-2928) > Limit flow runs returned while querying flows >

[jira] [Updated] (YARN-4239) Flow page for Web UI

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4239: --- Parent Issue: YARN-5355 (was: YARN-2928) > Flow page for Web UI > > >

[jira] [Updated] (YARN-4261) fix the order of timelinereader in yarn/yarn.cmd

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4261: --- Parent Issue: YARN-5355 (was: YARN-2928) > fix the order of timelinereader in yarn/yarn.cmd >

[jira] [Created] (YARN-5356) ResourceUtilization should also include resource availability

2016-07-11 Thread Nathan Roberts (JIRA)
Nathan Roberts created YARN-5356: Summary: ResourceUtilization should also include resource availability Key: YARN-5356 URL: https://issues.apache.org/jira/browse/YARN-5356 Project: Hadoop YARN

[jira] [Updated] (YARN-4173) Ensure the final values for metrics/events are emitted/stored at APP completion time

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4173: --- Parent Issue: YARN-5355 (was: YARN-2928) > Ensure the final values for metrics/events are

[jira] [Updated] (YARN-4220) [Storage implementation] Support getEntities with only Application id but no flow and flow run ID

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4220: --- Parent Issue: YARN-5355 (was: YARN-2928) > [Storage implementation] Support getEntities with

[jira] [Updated] (YARN-4116) refactor ColumnHelper read* methods

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4116: --- Parent Issue: YARN-5355 (was: YARN-2928) > refactor ColumnHelper read* methods >

[jira] [Updated] (YARN-4097) Create POC timeline web UI with new YARN web UI framework

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4097: --- Parent Issue: YARN-5355 (was: YARN-2928) > Create POC timeline web UI with new YARN web UI

[jira] [Updated] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4061: --- Parent Issue: YARN-5355 (was: YARN-2928) > [Fault tolerance] Fault tolerant writer for

[jira] [Updated] (YARN-3981) support timeline clients not associated with an application

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3981: --- Parent Issue: YARN-5355 (was: YARN-2928) > support timeline clients not associated with an

[jira] [Updated] (YARN-4069) For long running apps (> 2 days), populate flow activity table

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4069: --- Parent Issue: YARN-5355 (was: YARN-2928) > For long running apps (> 2 days), populate flow

[jira] [Updated] (YARN-3914) Entity created time should be part of the row key of entity table

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3914: --- Parent Issue: YARN-5355 (was: YARN-2928) > Entity created time should be part of the row key

[jira] [Updated] (YARN-3907) create the flow-version table

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3907: --- Parent Issue: YARN-5355 (was: YARN-2928) > create the flow-version table >

[jira] [Updated] (YARN-3880) Writing more RM side app-level metrics

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3880: --- Parent Issue: YARN-5355 (was: YARN-2928) > Writing more RM side app-level metrics >

[jira] [Updated] (YARN-3881) Writing RM cluster-level metrics

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3881: --- Parent Issue: YARN-5355 (was: YARN-2928) > Writing RM cluster-level metrics >

[jira] [Updated] (YARN-3895) Support ACLs in TimelineReader

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3895: --- Parent Issue: YARN-5355 (was: YARN-2928) > Support ACLs in TimelineReader >

[jira] [Updated] (YARN-3872) TimelineReader Web UI Implementation

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3872: --- Parent Issue: YARN-5355 (was: YARN-2928) > TimelineReader Web UI Implementation >

[jira] [Updated] (YARN-3865) Backward compatibility of reader with ATSv1

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3865: --- Parent Issue: YARN-5355 (was: YARN-2928) > Backward compatibility of reader with ATSv1 >

[jira] [Updated] (YARN-3874) Optimize and synchronize FS Reader and Writer Implementations

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3874: --- Parent Issue: YARN-5355 (was: YARN-2928) > Optimize and synchronize FS Reader and Writer

[jira] [Updated] (YARN-3879) [Storage implementation] Create HDFS backing storage implementation for ATS reads

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3879: --- Parent Issue: YARN-5355 (was: YARN-2928) > [Storage implementation] Create HDFS backing

[jira] [Commented] (YARN-3841) [Storage implementation] Adding retry semantics to HDFS backing storage

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371276#comment-15371276 ] Joep Rottinghuis commented on YARN-3841: [~ozawa] we have closed the work on the alpha-1 branch

[jira] [Updated] (YARN-3841) [Storage implementation] Adding retry semantics to HDFS backing storage

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3841: --- Parent Issue: YARN-5355 (was: YARN-2928) > [Storage implementation] Adding retry semantics to

[jira] [Updated] (YARN-3822) Scalability validation of RM writing app/attempt/container lifecycle events

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3822: --- Parent Issue: YARN-5355 (was: YARN-2928) > Scalability validation of RM writing

[jira] [Updated] (YARN-3818) [Aggregation] Queue-level Aggregation on Application States table

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3818: --- Parent Issue: YARN-5355 (was: YARN-2928) > [Aggregation] Queue-level Aggregation on

[jira] [Updated] (YARN-3817) [Aggregation] Flow and User level aggregation on Application States table

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3817: --- Parent Issue: YARN-5355 (was: YARN-2928) > [Aggregation] Flow and User level aggregation on

[jira] [Updated] (YARN-3741) consider nulling member maps/sets of TimelineEntity

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3741: --- Parent Issue: YARN-5355 (was: YARN-2928) > consider nulling member maps/sets of

[jira] [Updated] (YARN-3815) [Aggregation] Application/Flow/User/Queue Level Aggregations

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3815: --- Parent Issue: YARN-5355 (was: YARN-2928) > [Aggregation] Application/Flow/User/Queue Level

[jira] [Updated] (YARN-3650) Consider concurrency situations for TimelineWriter

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3650: --- Parent Issue: YARN-5355 (was: YARN-2928) > Consider concurrency situations for TimelineWriter

[jira] [Updated] (YARN-3649) Allow configurable prefix for hbase table names (like prod, exp, test etc)

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3649: --- Parent Issue: YARN-5355 (was: YARN-2928) > Allow configurable prefix for hbase table names

[jira] [Commented] (YARN-3649) Allow configurable prefix for hbase table names (like prod, exp, test etc)

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371245#comment-15371245 ] Joep Rottinghuis commented on YARN-3649: Does this need to be rebased? Should we also update the

[jira] [Updated] (YARN-3622) Enable application client to communicate with new timeline service

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3622: --- Parent Issue: YARN-5355 (was: YARN-2928) > Enable application client to communicate with new

[jira] [Updated] (YARN-3616) determine how to generate YARN container events

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3616: --- Parent Issue: YARN-5355 (was: YARN-2928) > determine how to generate YARN container events >

[jira] [Updated] (YARN-3588) Timeline entity uniqueness

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3588: --- Parent Issue: YARN-5355 (was: YARN-2928) > Timeline entity uniqueness >

[jira] [Updated] (YARN-3545) Investigate the concurrency issue with the map of timeline collector

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3545: --- Parent Issue: YARN-5355 (was: YARN-2928) > Investigate the concurrency issue with the map of

[jira] [Updated] (YARN-3509) CollectorNodemanagerProtocol's authorization doesn't work

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3509: --- Parent Issue: YARN-5355 (was: YARN-2928) > CollectorNodemanagerProtocol's authorization

  1   2   3   >