[jira] [Updated] (YARN-7560) Resourcemanager hangs when resourceUsedWithWeightToResourceRatio return a overflow value

2017-12-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7560: -- Fix Version/s: (was: 3.0.0) 3.0.1 > Resourcemanager hangs when

[jira] [Updated] (YARN-7646) MR job (based on old version tarball) get failed due to incompatible resource request

2017-12-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7646: -- Target Version/s: 3.0.1 (was: 3.0.0) > MR job (based on old version tarball) get failed due to

[jira] [Commented] (YARN-7646) MR job (based on old version tarball) get failed due to incompatible resource request

2017-12-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288572#comment-16288572 ] Andrew Wang commented on YARN-7646: --- At this point we just need to get 3.0.0 out, if there are compat

[jira] [Commented] (YARN-7290) Method canContainerBePreempted can return true when it shouldn't

2017-12-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284035#comment-16284035 ] Andrew Wang commented on YARN-7290: --- I pulled this into branch-3.0.0 as well, thanks folks. > Method

[jira] [Updated] (YARN-7390) All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.

2017-12-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7390: -- Fix Version/s: (was: 3.0.0) 3.0.1 > All reservation related test cases failed

[jira] [Commented] (YARN-7469) Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit

2017-12-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284032#comment-16284032 ] Andrew Wang commented on YARN-7469: --- I pulled this into branch-3.0.0 as well, thanks folks. > Capacity

[jira] [Updated] (YARN-7524) Remove unused FairSchedulerEventLog

2017-12-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7524: -- Fix Version/s: (was: 3.0.0) 3.0.1 > Remove unused FairSchedulerEventLog >

[jira] [Updated] (YARN-7611) Node manager web UI should display container type in containers page

2017-12-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7611: -- Fix Version/s: (was: 3.0.0) 3.0.1 > Node manager web UI should display container

[jira] [Updated] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7610: -- Fix Version/s: (was: 3.0.0) 3.0.1 > Extend Distributed Shell to support launching

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275232#comment-16275232 ] Andrew Wang commented on YARN-7590: --- Thanks Eric! > Improve container-executor validation check >

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275205#comment-16275205 ] Andrew Wang commented on YARN-7590: --- Hi folks, is this a release blocker? Could someone set the affects

[jira] [Updated] (YARN-7471) queueUsagePercentage is wrongly calculated for applications in zero-capacity queues

2017-12-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7471: -- Target Version/s: 3.1.0 (was: 3.0.0-alpha4) > queueUsagePercentage is wrongly calculated for

[jira] [Updated] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2017-12-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7461: -- Target Version/s: 3.1.0 (was: 3.0.0-alpha4) > DominantResourceCalculator#ratio calculation problem when

[jira] [Commented] (YARN-7509) AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby

2017-11-24 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265407#comment-16265407 ] Andrew Wang commented on YARN-7509: --- Please put it in, thanks Wangda for your attention! >

[jira] [Commented] (YARN-7430) Enable user re-mapping for Docker containers by default

2017-11-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262776#comment-16262776 ] Andrew Wang commented on YARN-7430: --- Sure, please backport. Thanks for the attention Varun! > Enable

[jira] [Updated] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-11-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7190: -- Target Version/s: 3.1.0 (was: 3.0.0, 3.1.0) > Ensure only NM classpath in 2.x gets TSv2 related hbase

[jira] [Updated] (YARN-7342) Application page doesn't show correct metrics for reservation runs

2017-11-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7342: -- Target Version/s: 3.1.0 (was: 3.0.0, 3.1.0) > Application page doesn't show correct metrics for

[jira] [Updated] (YARN-6907) Node information page in the old web UI should report resource types

2017-11-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6907: -- Target Version/s: 3.1.0 (was: 3.0.0, 3.1.0) > Node information page in the old web UI should report

[jira] [Updated] (YARN-6426) Compress ZK YARN keys to scale up (especially AppStateData

2017-11-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6426: -- Target Version/s: 3.1.0 (was: 3.0.0, 3.1.0) > Compress ZK YARN keys to scale up (especially

[jira] [Updated] (YARN-6789) Add Client API to get all supported resource types from RM

2017-11-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6789: -- Fix Version/s: (was: 3.1.0) 3.0.0 > Add Client API to get all supported resource

[jira] [Updated] (YARN-7412) test_docker_util.test_check_mount_permitted() is failing

2017-11-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7412: -- Fix Version/s: 3.0.0 > test_docker_util.test_check_mount_permitted() is failing >

[jira] [Updated] (YARN-5734) OrgQueue for easy CapacityScheduler queue configuration management

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5734: -- Release Note: The OrgQueue extension to the capacity scheduler provides a programmatic way to change

[jira] [Updated] (YARN-5734) OrgQueue for easy CapacityScheduler queue configuration management

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5734: -- Fix Version/s: 3.0.0 2.9.0 > OrgQueue for easy CapacityScheduler queue configuration

[jira] [Updated] (YARN-2882) Add an OPPORTUNISTIC ExecutionType

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-2882: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Add an OPPORTUNISTIC ExecutionType >

[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5124: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Modify AMRMClient to set the

[jira] [Updated] (YARN-5110) Fix OpportunisticContainerAllocator to insert complete HostAddress in issued ContainerTokenIds

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5110: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Fix OpportunisticContainerAllocator to

[jira] [Updated] (YARN-5090) Add End-to-End test-cases for DistributedScheduling using MiniYarnCluster

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5090: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Add End-to-End test-cases for

[jira] [Updated] (YARN-5117) QueuingContainerManager does not start GUARANTEED Container even if Resources are available

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5117: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > QueuingContainerManager does not start

[jira] [Updated] (YARN-5113) Refactoring and other clean-up for distributed scheduling

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5113: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Refactoring and other clean-up for

[jira] [Updated] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5171: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Extend DistributedSchedulerProtocol to

[jira] [Updated] (YARN-5162) Fix Exceptions thrown during registerAM call when Distributed Scheduling is Enabled

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5162: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Fix Exceptions thrown during

[jira] [Updated] (YARN-5176) More test cases for queuing of containers at the NM

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5176: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > More test cases for queuing of

[jira] [Updated] (YARN-5127) Expose ExecutionType in Container api record

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5127: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Expose ExecutionType in Container api

[jira] [Updated] (YARN-5221) Expose UpdateResourceRequest API to allow AM to request for change in container properties

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5221: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha2 > Expose UpdateResourceRequest API to

[jira] [Updated] (YARN-5204) Properly report status of killed/stopped queued containers

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5204: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Properly report status of

[jira] [Updated] (YARN-5212) Run existing ContainerManager tests using QueuingContainerManagerImpl

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5212: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Run existing ContainerManager tests

[jira] [Updated] (YARN-5180) Allow ResourceRequest to specify an enforceExecutionType flag

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5180: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Allow ResourceRequest to specify an

[jira] [Updated] (YARN-5350) Distributed Scheduling: Ensure sort order of allocatable nodes returned by the RM is not lost

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5350: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Distributed Scheduling: Ensure sort

[jira] [Updated] (YARN-5351) ResourceRequest should take ExecutionType into account during comparison

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5351: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > ResourceRequest should take

[jira] [Updated] (YARN-5457) Refactor DistributedScheduling framework to pull out common functionality

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5457: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Refactor DistributedScheduling

[jira] [Updated] (YARN-5833) Add validation to ensure default ports are unique in Configuration

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5833: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha2 > Add validation to ensure default ports

[jira] [Updated] (YARN-5799) Fix Opportunistic Allocation to set the correct value of Node Http Address

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5799: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha2 > Fix Opportunistic Allocation to set

[jira] [Updated] (YARN-5938) Refactoring OpportunisticContainerAllocator to use SchedulerRequestKey instead of Priority and other misc fixes

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5938: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha2 > Refactoring

[jira] [Updated] (YARN-5486) Update OpportunisticContainerAllocatorAMService::allocate method to handle OPPORTUNISTIC container requests

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5486: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha2 > Update

[jira] [Updated] (YARN-5966) AMRMClient changes to support ExecutionType update

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5966: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha4 > AMRMClient changes to support

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5959: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha2 > RM changes to support change of

[jira] [Updated] (YARN-6849) NMContainerStatus should have the Container ExecutionType.

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6849: -- Fix Version/s: (was: 3.0.0) 3.0.0-beta1 > NMContainerStatus should have the

[jira] [Commented] (YARN-6909) Use LightWeightedResource when number of resource types more than two

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250423#comment-16250423 ] Andrew Wang commented on YARN-6909: --- I think the branch-3.0 commit was missed, I backported it. > Use

[jira] [Updated] (YARN-5978) ContainerScheduler and ContainerManager changes to support ExecType update

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5978: -- Fix Version/s: (was: 3.0.0) 3.0.0-beta1 > ContainerScheduler and ContainerManager

[jira] [Updated] (YARN-5977) ContainerManagementProtocol changes to support change of container ExecutionType

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5977: -- Fix Version/s: (was: 3.0.0) 3.0.0-beta1 > ContainerManagementProtocol changes to

[jira] [Updated] (YARN-6978) Add updateContainer API to NMClient.

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6978: -- Fix Version/s: (was: 3.0.0) 3.0.0-beta1 > Add updateContainer API to NMClient. >

[jira] [Updated] (YARN-6979) Add flag to notify all types of container updates to NM via NodeHeartbeatResponse

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6979: -- Fix Version/s: (was: 3.0.0) 3.0.0-beta1 > Add flag to notify all types of

[jira] [Updated] (YARN-7173) Container update RM-NM communication fix for backward compatibility

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7173: -- Fix Version/s: (was: 3.0.0) 3.0.0-beta1 > Container update RM-NM communication

[jira] [Commented] (YARN-7465) start-yarn.sh fails to start ResourceManager unless running as root

2017-11-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246273#comment-16246273 ] Andrew Wang commented on YARN-7465: --- +1 thanks Sean! > start-yarn.sh fails to start ResourceManager

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246269#comment-16246269 ] Andrew Wang commented on YARN-7442: --- Hey, is this JIRA moving forwards? It's our last blocker for GA. Is

[jira] [Commented] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227662#comment-16227662 ] Andrew Wang commented on YARN-7240: --- Woops, my bad. I had the wrong base revision in my versions script,

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227526#comment-16227526 ] Andrew Wang commented on YARN-6623: --- Hi Varun, do you mind adding a release note for this JIRA, given

[jira] [Commented] (YARN-3661) Basic Federation UI

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227509#comment-16227509 ] Andrew Wang commented on YARN-3661: --- I think this was meant for branch-3.0 as well, I backported it. >

[jira] [Commented] (YARN-7389) Make TestResourceManager Scheduler agnostic

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227500#comment-16227500 ] Andrew Wang commented on YARN-7389: --- Great, I backported it to branch-3.0. > Make TestResourceManager

[jira] [Updated] (YARN-6509) Add a size threshold beyond which yarn logs will require a force option

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6509: -- Fix Version/s: 3.0.0 > Add a size threshold beyond which yarn logs will require a force option >

[jira] [Updated] (YARN-7194) Log aggregation status is always Failed with the newly added log aggregation IndexedFileFormat

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7194: -- Fix Version/s: (was: 3.0.0-beta1) 3.0.0 > Log aggregation status is always Failed

[jira] [Updated] (YARN-7072) Add a new log aggregation file format controller

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7072: -- Fix Version/s: (was: 3.0.0-beta1) 3.0.0 > Add a new log aggregation file format

[jira] [Updated] (YARN-7259) Add size-based rolling policy to LogAggregationIndexedFileController

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7259: -- Fix Version/s: (was: 3.0.0-beta1) 3.0.0 > Add size-based rolling policy to

[jira] [Updated] (YARN-7308) TestApplicationACLs fails with FairScheduler

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7308: -- Fix Version/s: 3.0.0 > TestApplicationACLs fails with FairScheduler >

[jira] [Updated] (YARN-7269) Tracking URL in the app state does not get redirected to ApplicationMaster for Running applications

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7269: -- Fix Version/s: (was: 3.0.0-beta1) 3.0.0 > Tracking URL in the app state does not

[jira] [Updated] (YARN-7339) LocalityMulticastAMRMProxyPolicy should handle cancel request properly

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7339: -- Fix Version/s: (was: 3.0) 3.0.0 > LocalityMulticastAMRMProxyPolicy should handle

[jira] [Commented] (YARN-3813) Support Application timeout feature in YARN.

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227388#comment-16227388 ] Andrew Wang commented on YARN-3813: --- Hi, could someone add a release note for this new feature? >

[jira] [Commented] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227379#comment-16227379 ] Andrew Wang commented on YARN-7240: --- Hi Arun, did you mean for this to go into branch-3.0 also? > Add

[jira] [Resolved] (YARN-7365) ResourceLocalization cache cleanup thread stuck

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved YARN-7365. --- Resolution: Duplicate Fix Version/s: (was: 3.1.0) (was: 3.0.0)

[jira] [Reopened] (YARN-7365) ResourceLocalization cache cleanup thread stuck

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened YARN-7365: --- > ResourceLocalization cache cleanup thread stuck > --- > >

[jira] [Commented] (YARN-7389) Make TestResourceManager Scheduler agnostic

2017-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227378#comment-16227378 ] Andrew Wang commented on YARN-7389: --- Hey Haibo, did you mean for this to go into branch-3.0 too? > Make

[jira] [Commented] (YARN-7178) Add documentation for Container Update API

2017-10-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221440#comment-16221440 ] Andrew Wang commented on YARN-7178: --- [~asuresh] ping again? > Add documentation for Container Update API

[jira] [Commented] (YARN-6142) Support rolling upgrade between 2.x and 3.x

2017-10-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213177#comment-16213177 ] Andrew Wang commented on YARN-6142: --- Hi Ray, what is left to do here? Is it tracking towards completion

[jira] [Commented] (YARN-7178) Add documentation for Container Update API

2017-10-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213164#comment-16213164 ] Andrew Wang commented on YARN-7178: --- Ping, is this one tracking towards completion by the end of the

[jira] [Updated] (YARN-7336) Unsafe cast from long to int Resource.hashCode() method

2017-10-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7336: -- Target Version/s: 3.0.0, 3.1.0 (was: 3.0.0-beta1, 3.1.0) > Unsafe cast from long to int

[jira] [Commented] (YARN-7307) Revisit resource-types.xml loading behaviors

2017-10-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197973#comment-16197973 ] Andrew Wang commented on YARN-7307: --- Hi Wangda, Sunil, should this be targeted at 3.0.0? > Revisit

[jira] [Commented] (YARN-7134) AppSchedulingInfo has a dependency on capacity scheduler

2017-10-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188698#comment-16188698 ] Andrew Wang commented on YARN-7134: --- Thanks Sunil! > AppSchedulingInfo has a dependency on capacity

[jira] [Commented] (YARN-4859) [Bug] Unable to submit a job to a reservation when using FairScheduler

2017-10-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188588#comment-16188588 ] Andrew Wang commented on YARN-4859: --- 3.0.0 release information is kept up to date here:

[jira] [Commented] (YARN-7178) Add documentation for Container Update API

2017-09-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186676#comment-16186676 ] Andrew Wang commented on YARN-7178: --- Is this a blocker for 3.0.0? Saw this pop up on my dashboard. > Add

[jira] [Commented] (YARN-4859) [Bug] Unable to submit a job to a reservation when using FairScheduler

2017-09-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186674#comment-16186674 ] Andrew Wang commented on YARN-4859: --- Is this a blocker for 3.0.0? Saw this pop up on my dashboard. >

[jira] [Commented] (YARN-7275) NM Statestore cleanup for Container updates

2017-09-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186677#comment-16186677 ] Andrew Wang commented on YARN-7275: --- Is this a blocker for 3.0.0? Saw this pop up on my dashboard. > NM

[jira] [Commented] (YARN-7134) AppSchedulingInfo has a dependency on capacity scheduler

2017-09-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186671#comment-16186671 ] Andrew Wang commented on YARN-7134: --- This one popped up on my dashboard as a 3.0.0 GA blocker, could I

[jira] [Commented] (YARN-4827) Document configuration of ReservationSystem for FairScheduler

2017-09-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186672#comment-16186672 ] Andrew Wang commented on YARN-4827: --- Is this a blocker for 3.0.0? Saw this pop up on my dashboard. >

[jira] [Updated] (YARN-6487) FairScheduler: remove continuous scheduling (YARN-1010)

2017-09-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6487: -- Target Version/s: (was: 3.0.0) > FairScheduler: remove continuous scheduling (YARN-1010) >

[jira] [Commented] (YARN-6241) Remove -jt flag

2017-09-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186659#comment-16186659 ] Andrew Wang commented on YARN-6241: --- Dropping 3.0.0 target version since this is an incompatible change

[jira] [Commented] (YARN-6487) FairScheduler: remove continuous scheduling (YARN-1010)

2017-09-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186658#comment-16186658 ] Andrew Wang commented on YARN-6487: --- Dropping 3.0.0 target version since this is an incompatible change

[jira] [Updated] (YARN-6241) Remove -jt flag

2017-09-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6241: -- Target Version/s: (was: 3.0.0) > Remove -jt flag > --- > > Key: YARN-6241

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186186#comment-16186186 ] Andrew Wang commented on YARN-6623: --- Sorry, this missed the train for RC0. We'll pick it up for GA, or

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6623: -- Fix Version/s: (was: 3.0.0-beta1) 3.0.0 > Add support to turn off launching

[jira] [Updated] (YARN-6426) Compress ZK YARN keys to scale up (especially AppStateData

2017-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6426: -- Target Version/s: 2.9.0, 2.8.3, 3.0.0 (was: 2.9.0, 3.0.0-beta1, 2.8.3) > Compress ZK YARN keys to scale

[jira] [Updated] (YARN-7084) TestSchedulingMonitor#testRMStarts fails sporadically

2017-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7084: -- Target Version/s: 2.9.0, 2.8.3, 2.7.5, 3.0.0 (was: 2.9.0, 3.0.0-beta1, 2.8.3, 2.7.5) >

[jira] [Updated] (YARN-7226) Whitelisted variables do not support delayed variable expansion

2017-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7226: -- Target Version/s: 2.9.0, 2.8.3, 3.0.0 (was: 2.9.0, 3.0.0-beta1, 2.8.3) > Whitelisted variables do not

[jira] [Updated] (YARN-4727) Unable to override the $HADOOP_CONF_DIR env variable for container

2017-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-4727: -- Fix Version/s: (was: 3.0.0) 3.0.0-beta1 > Unable to override the $HADOOP_CONF_DIR

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16184530#comment-16184530 ] Andrew Wang commented on YARN-7248: --- Gotcha, let's wait until post-beta1 then. Thanks Arun. > NM returns

[jira] [Commented] (YARN-6622) Document Docker work as experimental

2017-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16184489#comment-16184489 ] Andrew Wang commented on YARN-6622: --- This was missed from branch-3.0, I cherry-picked it. > Document

[jira] [Updated] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7248: -- Target Version/s: 2.9.0, 3.0.0, 3.1.0 (was: 2.9.0, 3.1.0) > NM returns new SCHEDULED container status

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6623: -- Target Version/s: 2.9.0, 2.8.2, 3.0.0 (was: 2.9.0, 3.0.0-beta1, 2.8.2) > Add support to turn off

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16184433#comment-16184433 ] Andrew Wang commented on YARN-6623: --- Thanks Varun. Considering this is targeted at 2.8.2, if we're okay

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16184425#comment-16184425 ] Andrew Wang commented on YARN-7248: --- Thanks for the ping. Please put it in branch-3.0. Given that the

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183050#comment-16183050 ] Andrew Wang commented on YARN-6623: --- Folks, this is currently marked as the last blocker for beta1. I

  1   2   3   4   >