Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-21 Thread Haibo Chen
lines Best, Haibo Chen On Mon, Mar 20, 2017 at 11:18 AM, Junping Du <j...@hortonworks.com> wrote: > ?Thanks for update, John. Then we should be OK with fixing this issue in > 2.8.1. > > Mark the target version of HADOOP-14205 to 2.8.1 instead of 2.8.0 and bump > up to blocker

Re: [DISCUSS] Looking to Apache Hadoop 3.1 release

2017-09-07 Thread Haibo Chen
Thanks Wangda for initiating 3.1.0 release efforts. One YARN feature I'd like to add to 3.1.0 is YARN Oversubscription (YARN-1011) Best, Haibo On Wed, Sep 6, 2017 at 11:13 AM, Wangda Tan wrote: > Hi all, > > As we discussed on [1], there were proposals from Steve / Vinod

Re: [VOTE] Merge feature branch YARN-5355 (Timeline Service v2) to trunk

2017-08-25 Thread Haibo Chen
as dynamic (table level) coprocessors > > - Uses latest stable HBase release 1.2.6 > > > > There are a total of 82 subtasks that were completed as part of this > > effort. > > > > We paid close attention to ensure that once disabled Timeline Service v.2 > > do

Re: Hadoop 3.2 Release Plan proposal

2018-09-04 Thread Haibo Chen
ngoing. > > - (Rohith) YARN-5742: Serve aggregated logs of historical apps from > ATSv2. > > Patch in progress. > > - (Virajit) HDFS-12615: Router-based HDFS federation. Improvement works. > > - (Steve) S3Guard Phase III, S3a phase V, Support Windows Azure Stor

Re: Hdfs build on branch-2 are failing.

2018-04-05 Thread Haibo Chen
Not sure why this did not show up in trunk. A quick google search takes me to bower-install-cert-untrusted-error On Thu, Apr 5, 2018 at 10:40 AM, Vrushali C wrote: > Seeing the same for

Re: [VOTE] Mark 2.6, 2.7, 3.0 release lines EOL

2019-08-21 Thread Haibo Chen
+1 Haibo From: Erik Krogen Sent: Wednesday, August 21, 2019 08:28 To: Jonathan Eagles ; Sunil Govindan Cc: Wangda Tan ; yarn-dev ; Hdfs-dev ; mapreduce-dev ; Hadoop Common Subject: Re: [VOTE] Mark 2.6, 2.7, 3.0 release lines EOL +1 thanks for initiating an

[jira] [Created] (YARN-5236) FlowRunCoprocessor brings down HBase RegionServer

2016-06-10 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5236: Summary: FlowRunCoprocessor brings down HBase RegionServer Key: YARN-5236 URL: https://issues.apache.org/jira/browse/YARN-5236 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-4697) NM aggregation thread pool is not bound by limits

2016-02-16 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-4697: Summary: NM aggregation thread pool is not bound by limits Key: YARN-4697 URL: https://issues.apache.org/jira/browse/YARN-4697 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-4701) When task logs are not available, port 8041 is referenced instead of port 8042

2016-02-17 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-4701: Summary: When task logs are not available, port 8041 is referenced instead of port 8042 Key: YARN-4701 URL: https://issues.apache.org/jira/browse/YARN-4701 Project: Hadoop

[jira] [Created] (YARN-4838) TestLogAggregationService. testLocalFileDeletionOnDiskFull failed

2016-03-19 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-4838: Summary: TestLogAggregationService. testLocalFileDeletionOnDiskFull failed Key: YARN-4838 URL: https://issues.apache.org/jira/browse/YARN-4838 Project: Hadoop YARN

[jira] [Created] (YARN-4766) NM should not aggregate logs older than the retention policy

2016-03-04 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-4766: Summary: NM should not aggregate logs older than the retention policy Key: YARN-4766 URL: https://issues.apache.org/jira/browse/YARN-4766 Project: Hadoop YARN

[jira] [Created] (YARN-5001) Aggregated Logs root directory is created with wrong owner and group if nonexistent

2016-04-26 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5001: Summary: Aggregated Logs root directory is created with wrong owner and group if nonexistent Key: YARN-5001 URL: https://issues.apache.org/jira/browse/YARN-5001 Project

[jira] [Created] (YARN-5381) fix NPE listing wildcard directory on Windows

2016-07-14 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5381: Summary: fix NPE listing wildcard directory on Windows Key: YARN-5381 URL: https://issues.apache.org/jira/browse/YARN-5381 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-5373) NPE introduced by YARN-4958 (The file localization process should allow...)

2016-07-13 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5373: Summary: NPE introduced by YARN-4958 (The file localization process should allow...) Key: YARN-5373 URL: https://issues.apache.org/jira/browse/YARN-5373 Project: Hadoop YARN

[jira] [Resolved] (YARN-5381) fix NPE listing wildcard directory on Windows

2016-07-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-5381. -- Resolution: Workaround > fix NPE listing wildcard directory on Wind

[jira] [Resolved] (YARN-6030) Eliminate timelineServiceV2 boolean flag in TimelineClientImpl

2017-02-24 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-6030. -- Resolution: Not A Problem > Eliminate timelineServiceV2 boolean flag in TimelineClientI

[jira] [Resolved] (YARN-5667) Move HBase backend code in ATS v2 into its separate module

2017-01-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-5667. -- Resolution: Done > Move HBase backend code in ATS v2 into its separate mod

[jira] [Created] (YARN-6253) FlowAcitivityColumnPrefix.store(byte[] rowKey, ...) drops timestamp

2017-02-28 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6253: Summary: FlowAcitivityColumnPrefix.store(byte[] rowKey, ...) drops timestamp Key: YARN-6253 URL: https://issues.apache.org/jira/browse/YARN-6253 Project: Hadoop YARN

[jira] [Created] (YARN-5667) Move HBase backend code in ATS v2 into its separate module

2016-09-25 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5667: Summary: Move HBase backend code in ATS v2 into its separate module Key: YARN-5667 URL: https://issues.apache.org/jira/browse/YARN-5667 Project: Hadoop YARN Issue

[jira] [Created] (YARN-5851) TestContainerManagerSecurity testContainerManager[1] failed

2016-11-07 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5851: Summary: TestContainerManagerSecurity testContainerManager[1] failed Key: YARN-5851 URL: https://issues.apache.org/jira/browse/YARN-5851 Project: Hadoop YARN

[jira] [Resolved] (YARN-4838) TestLogAggregationService. testLocalFileDeletionOnDiskFull failed

2016-11-04 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-4838. -- Resolution: Duplicate > TestLogAggregationService. testLocalFileDeletionOnDiskFull fai

[jira] [Resolved] (YARN-5733) Run PerNodeTimelineCollectorsAuxService in a system container

2016-10-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-5733. -- Resolution: Duplicate > Run PerNodeTimelineCollectorsAuxService in a system contai

[jira] [Created] (YARN-5765) LinuxContainerExecutor creates appcache/{appId} with wrong group owner.

2016-10-21 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5765: Summary: LinuxContainerExecutor creates appcache/{appId} with wrong group owner. Key: YARN-5765 URL: https://issues.apache.org/jira/browse/YARN-5765 Project: Hadoop YARN

[jira] [Created] (YARN-5753) NPE in AMRMClientImpl.getMatchingRequests(Priority, String, ExecutionType,Resource)

2016-10-19 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5753: Summary: NPE in AMRMClientImpl.getMatchingRequests(Priority, String, ExecutionType,Resource) Key: YARN-5753 URL: https://issues.apache.org/jira/browse/YARN-5753 Project

[jira] [Created] (YARN-5922) Remove direct references of HBaseTimelineWriter/Reader in core ATS classes

2016-11-21 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5922: Summary: Remove direct references of HBaseTimelineWriter/Reader in core ATS classes Key: YARN-5922 URL: https://issues.apache.org/jira/browse/YARN-5922 Project: Hadoop YARN

[jira] [Created] (YARN-5925) Extract hbase-backend-exclusive utility methods from TImelineStorageUtil

2016-11-22 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5925: Summary: Extract hbase-backend-exclusive utility methods from TImelineStorageUtil Key: YARN-5925 URL: https://issues.apache.org/jira/browse/YARN-5925 Project: Hadoop YARN

[jira] [Created] (YARN-5928) Move HBase backend code into a new module that the hadoop-yarn-server-timelineservice module depends on only at runtime

2016-11-22 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5928: Summary: Move HBase backend code into a new module that the hadoop-yarn-server-timelineservice module depends on only at runtime Key: YARN-5928 URL: https://issues.apache.org/jira/browse

[jira] [Created] (YARN-5894) license warning in de.ruedigermoeller:fst:jar:2.24

2016-11-16 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5894: Summary: license warning in de.ruedigermoeller:fst:jar:2.24 Key: YARN-5894 URL: https://issues.apache.org/jira/browse/YARN-5894 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-5903) Fix race condition in TestResourceManagerAdministrationProtocolPBClientImpl beforeclass setup method

2016-11-17 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5903: Summary: Fix race condition in TestResourceManagerAdministrationProtocolPBClientImpl beforeclass setup method Key: YARN-5903 URL: https://issues.apache.org/jira/browse/YARN-5903

[jira] [Created] (YARN-5901) Fix race condition in TestGetGroups beforeclass setup()

2016-11-17 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5901: Summary: Fix race condition in TestGetGroups beforeclass setup() Key: YARN-5901 URL: https://issues.apache.org/jira/browse/YARN-5901 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-5732) Run auxiliary services in system containers

2016-10-13 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5732: Summary: Run auxiliary services in system containers Key: YARN-5732 URL: https://issues.apache.org/jira/browse/YARN-5732 Project: Hadoop YARN Issue Type: Task

[jira] [Created] (YARN-5733) Run PerNodeTimelineCollectorsAuxService in a system container

2016-10-13 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5733: Summary: Run PerNodeTimelineCollectorsAuxService in a system container Key: YARN-5733 URL: https://issues.apache.org/jira/browse/YARN-5733 Project: Hadoop YARN

[jira] [Resolved] (YARN-5732) Run auxiliary services in system containers

2016-10-13 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-5732. -- Resolution: Duplicate > Run auxiliary services in system contain

[jira] [Created] (YARN-6377) NMTimelinePublisher#serviceStop does not stop timeline clients

2017-03-22 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6377: Summary: NMTimelinePublisher#serviceStop does not stop timeline clients Key: YARN-6377 URL: https://issues.apache.org/jira/browse/YARN-6377 Project: Hadoop YARN

[jira] [Created] (YARN-6382) Address race condition on TimelineWriter.flush() caused by buffer-sized flush

2017-03-23 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6382: Summary: Address race condition on TimelineWriter.flush() caused by buffer-sized flush Key: YARN-6382 URL: https://issues.apache.org/jira/browse/YARN-6382 Project: Hadoop

[jira] [Created] (YARN-6310) OutputStreams in AggregatedLogFormat.LogWriter can be left open upon exceptions

2017-03-08 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6310: Summary: OutputStreams in AggregatedLogFormat.LogWriter can be left open upon exceptions Key: YARN-6310 URL: https://issues.apache.org/jira/browse/YARN-6310 Project: Hadoop

[jira] [Resolved] (YARN-3471) Fix timeline client retry

2017-03-07 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-3471. -- Resolution: Not A Problem > Fix timeline client re

[jira] [Created] (YARN-6296) ReservationId.compareTo ignores id when clustertimestamp is the same

2017-03-07 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6296: Summary: ReservationId.compareTo ignores id when clustertimestamp is the same Key: YARN-6296 URL: https://issues.apache.org/jira/browse/YARN-6296 Project: Hadoop YARN

[jira] [Resolved] (YARN-6252) Suspicious code fragments: comparing with itself

2017-03-07 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-6252. -- Resolution: Duplicate > Suspicious code fragments: comparing with its

[jira] [Created] (YARN-6297) TestAppLogAggregatorImp.verifyFilesUploaded() should check # of filed uploaded with that of files expected

2017-03-07 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6297: Summary: TestAppLogAggregatorImp.verifyFilesUploaded() should check # of filed uploaded with that of files expected Key: YARN-6297 URL: https://issues.apache.org/jira/browse/YARN-6297

[jira] [Created] (YARN-6455) Enhance the timelinewriter.flush() race condition fix in YARN-6382

2017-04-06 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6455: Summary: Enhance the timelinewriter.flush() race condition fix in YARN-6382 Key: YARN-6455 URL: https://issues.apache.org/jira/browse/YARN-6455 Project: Hadoop YARN

[jira] [Created] (YARN-6931) Make the aggregation interval in AppLevelTimelineCollector configurable

2017-08-02 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6931: Summary: Make the aggregation interval in AppLevelTimelineCollector configurable Key: YARN-6931 URL: https://issues.apache.org/jira/browse/YARN-6931 Project: Hadoop YARN

[jira] [Created] (YARN-6795) Add per-node max allocation threshold with respect to its capacity

2017-07-10 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6795: Summary: Add per-node max allocation threshold with respect to its capacity Key: YARN-6795 URL: https://issues.apache.org/jira/browse/YARN-6795 Project: Hadoop YARN

[jira] [Created] (YARN-6794) promote OPPORTUNISITC containers locally at the node where they're running

2017-07-10 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6794: Summary: promote OPPORTUNISITC containers locally at the node where they're running Key: YARN-6794 URL: https://issues.apache.org/jira/browse/YARN-6794 Project: Hadoop YARN

[jira] [Created] (YARN-6796) Add unit test for NM to launch OPPORTUNISTIC container for oversubscription

2017-07-10 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6796: Summary: Add unit test for NM to launch OPPORTUNISTIC container for oversubscription Key: YARN-6796 URL: https://issues.apache.org/jira/browse/YARN-6796 Project: Hadoop YARN

[jira] [Created] (YARN-6800) Add opportunity to start containers while periodically checking for preemption

2017-07-10 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6800: Summary: Add opportunity to start containers while periodically checking for preemption Key: YARN-6800 URL: https://issues.apache.org/jira/browse/YARN-6800 Project: Hadoop

[jira] [Created] (YARN-6767) Timeline client won't be able to write when TimelineCollector is not up yet, or NM is down

2017-07-06 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6767: Summary: Timeline client won't be able to write when TimelineCollector is not up yet, or NM is down Key: YARN-6767 URL: https://issues.apache.org/jira/browse/YARN-6767

[jira] [Created] (YARN-6812) Consolidate ContainerScheduler maxOpprQueueLength with ContainerQueuingLimit

2017-07-12 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6812: Summary: Consolidate ContainerScheduler maxOpprQueueLength with ContainerQueuingLimit Key: YARN-6812 URL: https://issues.apache.org/jira/browse/YARN-6812 Project: Hadoop

[jira] [Resolved] (YARN-6806) Scheduler-agnostic RM changes support oversubscription

2017-07-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-6806. -- Resolution: Duplicate > Scheduler-agnostic RM changes support oversubscript

[jira] [Created] (YARN-6843) Add unit test for NM to preemption OPPORTUNISTIC containers under high utilization

2017-07-19 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6843: Summary: Add unit test for NM to preemption OPPORTUNISTIC containers under high utilization Key: YARN-6843 URL: https://issues.apache.org/jira/browse/YARN-6843 Project

[jira] [Created] (YARN-6806) Scheduler-agnostic RM changes support oversubscription

2017-07-11 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6806: Summary: Scheduler-agnostic RM changes support oversubscription Key: YARN-6806 URL: https://issues.apache.org/jira/browse/YARN-6806 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-6750) Add a configuration to cap how much a NM can be overallocated

2017-06-29 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6750: Summary: Add a configuration to cap how much a NM can be overallocated Key: YARN-6750 URL: https://issues.apache.org/jira/browse/YARN-6750 Project: Hadoop YARN

[jira] [Created] (YARN-6921) Allow resource request to opt out of oversubscription

2017-08-01 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6921: Summary: Allow resource request to opt out of oversubscription Key: YARN-6921 URL: https://issues.apache.org/jira/browse/YARN-6921 Project: Hadoop YARN Issue Type

[jira] [Resolved] (YARN-6843) Add unit test for NM to preempt OPPORTUNISTIC containers under high utilization

2017-08-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-6843. -- Resolution: Duplicate Unit tests will be added as part of YARN-6672 > Add unit test for NM to pree

[jira] [Resolved] (YARN-6796) Add unit test for NM to launch OPPORTUNISTIC container for overallocation

2017-08-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-6796. -- Resolution: Duplicate > Add unit test for NM to launch OPPORTUNISTIC container for overallocat

[jira] [Created] (YARN-6586) YARN to facilitate HTTPS in AM web server

2017-05-11 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6586: Summary: YARN to facilitate HTTPS in AM web server Key: YARN-6586 URL: https://issues.apache.org/jira/browse/YARN-6586 Project: Hadoop YARN Issue Type: Improvement

[jira] [Resolved] (YARN-5841) Report only local collectors on node upon resync with RM after RM fails over

2017-05-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-5841. -- Resolution: Not A Problem > Report only local collectors on node upon resync with RM after RM fails o

[jira] [Created] (YARN-6604) Allow metric TTL for Application table to be specified through cmd

2017-05-15 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6604: Summary: Allow metric TTL for Application table to be specified through cmd Key: YARN-6604 URL: https://issues.apache.org/jira/browse/YARN-6604 Project: Hadoop YARN

[jira] [Created] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-06-09 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6706: Summary: Refactor ContainerScheduler to make oversubscription change easier Key: YARN-6706 URL: https://issues.apache.org/jira/browse/YARN-6706 Project: Hadoop YARN

[jira] [Created] (YARN-6705) Add separate NM preemption thresholds for cpu and memory

2017-06-09 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6705: Summary: Add separate NM preemption thresholds for cpu and memory Key: YARN-6705 URL: https://issues.apache.org/jira/browse/YARN-6705 Project: Hadoop YARN Issue

[jira] [Created] (YARN-6739) Crash NM at start time if oversubscription is on but LinuxContainerExcutor or cgroup is off

2017-06-23 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6739: Summary: Crash NM at start time if oversubscription is on but LinuxContainerExcutor or cgroup is off Key: YARN-6739 URL: https://issues.apache.org/jira/browse/YARN-6739

[jira] [Resolved] (YARN-6671) Add container type awareness in ResourceHandlers.

2017-06-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-6671. -- Resolution: Not A Problem > Add container type awareness in ResourceHandl

[jira] [Created] (YARN-6723) NM overallocation based on over-time rather than snapshot utilization

2017-06-19 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6723: Summary: NM overallocation based on over-time rather than snapshot utilization Key: YARN-6723 URL: https://issues.apache.org/jira/browse/YARN-6723 Project: Hadoop YARN

[jira] [Created] (YARN-6660) Display containers of applications returned from ATSv2

2017-05-26 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6660: Summary: Display containers of applications returned from ATSv2 Key: YARN-6660 URL: https://issues.apache.org/jira/browse/YARN-6660 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-6659) New web UI query history applications from ATSv2

2017-05-26 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6659: Summary: New web UI query history applications from ATSv2 Key: YARN-6659 URL: https://issues.apache.org/jira/browse/YARN-6659 Project: Hadoop YARN Issue Type: Wish

[jira] [Created] (YARN-6658) Remove columnFor() methods of Columns in HBaseTimeline backend

2017-05-26 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6658: Summary: Remove columnFor() methods of Columns in HBaseTimeline backend Key: YARN-6658 URL: https://issues.apache.org/jira/browse/YARN-6658 Project: Hadoop YARN

[jira] [Resolved] (YARN-6660) Display containers of applications returned from ATSv2

2017-05-26 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-6660. -- Resolution: Duplicate > Display containers of applications returned from AT

[jira] [Created] (YARN-6657) The column family indicated in AppToFlowTable class javadoc is wrong

2017-05-26 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6657: Summary: The column family indicated in AppToFlowTable class javadoc is wrong Key: YARN-6657 URL: https://issues.apache.org/jira/browse/YARN-6657 Project: Hadoop YARN

[jira] [Created] (YARN-6656) The column family indicated in AppToFlowTable class javadoc is wrong

2017-05-26 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6656: Summary: The column family indicated in AppToFlowTable class javadoc is wrong Key: YARN-6656 URL: https://issues.apache.org/jira/browse/YARN-6656 Project: Hadoop YARN

[jira] [Created] (YARN-6651) Flow Activity page should specify 'metricstoretrieve' in its query to ATSv2 to get back CPU and memory

2017-05-25 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6651: Summary: Flow Activity page should specify 'metricstoretrieve' in its query to ATSv2 to get back CPU and memory Key: YARN-6651 URL: https://issues.apache.org/jira/browse/YARN-6651

[jira] [Created] (YARN-6653) Retrieve CPU and MEMORY metrics for applications in a flow run

2017-05-25 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6653: Summary: Retrieve CPU and MEMORY metrics for applications in a flow run Key: YARN-6653 URL: https://issues.apache.org/jira/browse/YARN-6653 Project: Hadoop YARN

[jira] [Created] (YARN-6652) Merge flow info and flow runs

2017-05-25 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6652: Summary: Merge flow info and flow runs Key: YARN-6652 URL: https://issues.apache.org/jira/browse/YARN-6652 Project: Hadoop YARN Issue Type: Improvement

[jira] [Created] (YARN-6668) Use cgroup to get container resource utilization

2017-05-30 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6668: Summary: Use cgroup to get container resource utilization Key: YARN-6668 URL: https://issues.apache.org/jira/browse/YARN-6668 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-6671) Add container type awareness in ResourceHandlers.

2017-05-30 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6671: Summary: Add container type awareness in ResourceHandlers. Key: YARN-6671 URL: https://issues.apache.org/jira/browse/YARN-6671 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-6672) Add NM preemption of opportunistic containers

2017-05-30 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6672: Summary: Add NM preemption of opportunistic containers Key: YARN-6672 URL: https://issues.apache.org/jira/browse/YARN-6672 Project: Hadoop YARN Issue Type: Task

[jira] [Resolved] (YARN-6656) The column family indicated in AppToFlowTable class javadoc is wrong

2017-05-30 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-6656. -- Resolution: Duplicate > The column family indicated in AppToFlowTable class javadoc is wr

[jira] [Created] (YARN-6674) Add memory cgroup settings for opportunistic containers

2017-05-30 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6674: Summary: Add memory cgroup settings for opportunistic containers Key: YARN-6674 URL: https://issues.apache.org/jira/browse/YARN-6674 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-6673) Add cpu cgroup configurations for opportunistic containers

2017-05-30 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6673: Summary: Add cpu cgroup configurations for opportunistic containers Key: YARN-6673 URL: https://issues.apache.org/jira/browse/YARN-6673 Project: Hadoop YARN Issue

[jira] [Created] (YARN-6675) Add NM support to launch opportunistic containers based on oversubscription

2017-05-30 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6675: Summary: Add NM support to launch opportunistic containers based on oversubscription Key: YARN-6675 URL: https://issues.apache.org/jira/browse/YARN-6675 Project: Hadoop YARN

[jira] [Created] (YARN-6677) Pause and preempt containers when root container cgroup goes over memory limit

2017-05-31 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6677: Summary: Pause and preempt containers when root container cgroup goes over memory limit Key: YARN-6677 URL: https://issues.apache.org/jira/browse/YARN-6677 Project: Hadoop

[jira] [Resolved] (YARN-6670) Add over-allocation thresholds to allow per-node oversubscription

2017-05-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-6670. -- Resolution: Duplicate > Add over-allocation thresholds to allow per-node oversubscript

[jira] [Created] (YARN-6670) Add a new configuration, over-allocation threshold, to allow per-node oversubscription

2017-05-30 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6670: Summary: Add a new configuration, over-allocation threshold, to allow per-node oversubscription Key: YARN-6670 URL: https://issues.apache.org/jira/browse/YARN-6670 Project

[jira] [Created] (YARN-6690) Consolidate NM overallocation thresholds with ResourceTypes

2017-06-05 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6690: Summary: Consolidate NM overallocation thresholds with ResourceTypes Key: YARN-6690 URL: https://issues.apache.org/jira/browse/YARN-6690 Project: Hadoop YARN

[jira] [Created] (YARN-7300) DiskValidator is not used in LocalDirAllocator

2017-10-09 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7300: Summary: DiskValidator is not used in LocalDirAllocator Key: YARN-7300 URL: https://issues.apache.org/jira/browse/YARN-7300 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-7334) Add documentation of oversubscription

2017-10-16 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7334: Summary: Add documentation of oversubscription Key: YARN-7334 URL: https://issues.apache.org/jira/browse/YARN-7334 Project: Hadoop YARN Issue Type: Bug Affects

[jira] [Created] (YARN-7337) Expose per-node over-allocation info in Resource Manager

2017-10-16 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7337: Summary: Expose per-node over-allocation info in Resource Manager Key: YARN-7337 URL: https://issues.apache.org/jira/browse/YARN-7337 Project: Hadoop YARN Issue

[jira] [Resolved] (YARN-7032) [ATSv2] NPE while starting hbase co-processor

2017-08-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-7032. -- Resolution: Won't Fix > [ATSv2] NPE while starting hbase co-proces

[jira] [Resolved] (YARN-7362) Set assumption of capacity scheduler for TestClientRMService.testUpdateApplicationPriorityRequest() and testUpdatePriorityAndKillAppWithZeroClusterResource()

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-7362. -- Resolution: Duplicate > Set assumption of capacity schedu

[jira] [Created] (YARN-7360) TestRM.testNMTokenSentForNormalContainer() fails with Fair Scheduler

2017-10-18 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7360: Summary: TestRM.testNMTokenSentForNormalContainer() fails with Fair Scheduler Key: YARN-7360 URL: https://issues.apache.org/jira/browse/YARN-7360 Project: Hadoop YARN

[jira] [Created] (YARN-7358) TestZKConfigurationStore and TestZKConfigurationStore should explicitly set capacity scheduler

2017-10-18 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7358: Summary: TestZKConfigurationStore and TestZKConfigurationStore should explicitly set capacity scheduler Key: YARN-7358 URL: https://issues.apache.org/jira/browse/YARN-7358

[jira] [Created] (YARN-7362) Explicitly set assumption of capacity scheduler for TestClientRMService. testUpdateApplicationPriorityRequest() and testUpdatePriorityAndKillAppWithZeroClusterResource()

2017-10-18 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7362: Summary: Explicitly set assumption of capacity scheduler for TestClientRMService. testUpdateApplicationPriorityRequest() and testUpdatePriorityAndKillAppWithZeroClusterResource() Key: YARN-7362

[jira] [Created] (YARN-7355) TestDistributedShell should be scheduler agnostic

2017-10-18 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7355: Summary: TestDistributedShell should be scheduler agnostic Key: YARN-7355 URL: https://issues.apache.org/jira/browse/YARN-7355 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-7359) TestAppManager.testQueueSubmitWithNoPermission()

2017-10-18 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7359: Summary: TestAppManager.testQueueSubmitWithNoPermission() Key: YARN-7359 URL: https://issues.apache.org/jira/browse/YARN-7359 Project: Hadoop YARN Issue Type: Bug

[jira] [Resolved] (YARN-7373) The atomicity of container update in RM is not clear

2017-10-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-7373. -- Resolution: Information Provided > The atomicity of container update in RM is not cl

[jira] [Created] (YARN-7581) ATSv2 does not construct HBase filters correctly in HBase 2.0

2017-11-29 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7581: Summary: ATSv2 does not construct HBase filters correctly in HBase 2.0 Key: YARN-7581 URL: https://issues.apache.org/jira/browse/YARN-7581 Project: Hadoop YARN

[jira] [Created] (YARN-7491) Make sure AM is not scheduled on an opportunistic container

2017-11-13 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7491: Summary: Make sure AM is not scheduled on an opportunistic container Key: YARN-7491 URL: https://issues.apache.org/jira/browse/YARN-7491 Project: Hadoop YARN Issue

[jira] [Created] (YARN-7548) TestCapacityOverTimePolicy.testAllocation is flaky

2017-11-21 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7548: Summary: TestCapacityOverTimePolicy.testAllocation is flaky Key: YARN-7548 URL: https://issues.apache.org/jira/browse/YARN-7548 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-7514) TestAggregatedLogDeletionService.testRefreshLogRetentionSettings is flaky

2017-11-16 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7514: Summary: TestAggregatedLogDeletionService.testRefreshLogRetentionSettings is flaky Key: YARN-7514 URL: https://issues.apache.org/jira/browse/YARN-7514 Project: Hadoop YARN

[jira] [Created] (YARN-7531) ResourceRequest.equal does not check ExecutionTypeRequest.enforceExecutionType()

2017-11-17 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7531: Summary: ResourceRequest.equal does not check ExecutionTypeRequest.enforceExecutionType() Key: YARN-7531 URL: https://issues.apache.org/jira/browse/YARN-7531 Project: Hadoop

[jira] [Created] (YARN-7460) Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers

2017-11-07 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7460: Summary: Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers Key: YARN-7460 URL: https://issues.apache.org/jira/browse/YARN-7460

  1   2   >