[jira] [Updated] (YARN-5719) Enforce a C standard for native container-executor

2016-10-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5719: -- Target Version/s: 3.0.0-alpha2 (was: 3.0.0-alpha1) > Enforce a C standard for native container-executor

[jira] [Updated] (YARN-5433) Audit dependencies for Category-X

2016-10-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5433: -- Target Version/s: 3.0.0-alpha2 (was: 3.0.0-alpha1) > Audit dependencies for Category-X > ---

[jira] [Updated] (YARN-5703) ReservationAgents are not correctly configured

2016-10-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5703: -- Target Version/s: 3.0.0-alpha2 (was: 3.0.0-alpha1) > ReservationAgents are not correctly configured > --

[jira] [Updated] (YARN-5184) Fix up incompatible changes introduced in YARN-2882

2016-10-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5184: -- Target Version/s: 2.9.0, 3.0.0-alpha2 (was: 2.9.0) > Fix up incompatible changes introduced in YARN-2882

[jira] [Commented] (YARN-5184) Fix up incompatible changes introduced in YARN-2882

2016-10-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15583862#comment-15583862 ] Andrew Wang commented on YARN-5184: --- Looks like this is something we should address in 3.

[jira] [Updated] (YARN-4843) [Umbrella] Revisit YARN ProtocolBuffer int32 usages that need to upgrade to int64

2016-10-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-4843: -- Affects Version/s: 3.0.0-alpha1 Target Version/s: 3.0.0-alpha2 (was: ) Hi folks, looks like there a

[jira] [Updated] (YARN-4843) [Umbrella] Revisit YARN ProtocolBuffer int32 usages that need to upgrade to int64

2016-10-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-4843: -- Priority: Critical (was: Major) > [Umbrella] Revisit YARN ProtocolBuffer int32 usages that need to upgra

[jira] [Updated] (YARN-5697) Use CliParser to parse options in RMAdminCLI

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5697: -- Target Version/s: 2.8.0 Fix Version/s: (was: 2.8.0) As a reminder, please don't set the Fix Ve

[jira] [Updated] (YARN-5631) Missing refreshClusterMaxPriority usage in rmadmin help message

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5631: -- Fix Version/s: 3.0.0-alpha2 As a reminder, please set a 3.x fix version too when committing. Thanks! > M

[jira] [Updated] (YARN-5616) Clean up WeightAdjuster

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5616: -- Fix Version/s: 3.0.0-alpha2 As a reminder, please set a 3.x fix version when committing too. Thanks! > C

[jira] [Updated] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5609: -- Fix Version/s: 3.0.0-alpha2 As a reminder, please set a 3.x fix version when committing too. Thanks! > E

[jira] [Updated] (YARN-5555) Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested.

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-: -- Fix Version/s: 3.0.0-alpha2 As a reminder, please set a 3.x fix version when committing too. Thanks! > S

[jira] [Updated] (YARN-5608) TestAMRMClient.setup() fails with ArrayOutOfBoundsException

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5608: -- Fix Version/s: 3.0.0-alpha2 > TestAMRMClient.setup() fails with ArrayOutOfBoundsException > -

[jira] [Updated] (YARN-5549) AMLauncher#createAMContainerLaunchContext() should not log the command to be launched indiscriminately

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5549: -- Fix Version/s: 3.0.0-alpha2 As a reminder, please set a 3.x fix version when committing too. Thanks! > A

[jira] [Updated] (YARN-5419) fair scheduler page couldn't displayed sometimes

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5419: -- Fix Version/s: (was: 2.8.0) > fair scheduler page couldn't displayed sometimes >

[jira] [Updated] (YARN-5427) Labeled apps cant use resources in 2.8

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5427: -- Fix Version/s: (was: 2.8.0) > Labeled apps cant use resources in 2.8 > -

[jira] [Updated] (YARN-5388) MAPREDUCE-6719 requires changes to DockerContainerExecutor

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5388: -- Fix Version/s: (was: 2.9.0) > MAPREDUCE-6719 requires changes to DockerContainerExecutor > --

[jira] [Updated] (YARN-5338) Fix ContainerId fromString to correctly parse remotely allocated container Ids

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5338: -- Fix Version/s: (was: 2.9.0) > Fix ContainerId fromString to correctly parse remotely allocated contai

[jira] [Updated] (YARN-5311) Document graceful decommission CLI and usage

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5311: -- Fix Version/s: (was: 2.9.0) > Document graceful decommission CLI and usage >

[jira] [Updated] (YARN-5268) DShell AM fails java.lang.InterruptedException

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5268: -- Fix Version/s: (was: 2.9.0) > DShell AM fails java.lang.InterruptedException > --

[jira] [Updated] (YARN-5264) Store all queue-specific information in FSQueue

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5264: -- Fix Version/s: 3.0.0-alpha2 > Store all queue-specific information in FSQueue > -

[jira] [Updated] (YARN-5160) Add timeout when starting JobHistoryServer in MiniMRYarnCluster

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5160: -- Fix Version/s: (was: 2.8.0) > Add timeout when starting JobHistoryServer in MiniMRYarnCluster > -

[jira] [Updated] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5216: -- Fix Version/s: (was: 2.9.0) > Expose configurable preemption policy for OPPORTUNISTIC containers runn

[jira] [Updated] (YARN-5101) YARN_APPLICATION_UPDATED event is parsed in ApplicationHistoryManagerOnTimelineStore#convertToApplicationReport with reversed order

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5101: -- Fix Version/s: 3.0.0-alpha2 > YARN_APPLICATION_UPDATED event is parsed in > ApplicationHistoryManagerOnT

[jira] [Updated] (YARN-4591) YARN Web UIs should provide a robots.txt

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-4591: -- Fix Version/s: 3.0.0-alpha2 > YARN Web UIs should provide a robots.txt >

[jira] [Updated] (YARN-4818) AggregatedLogFormat.LogValue.write() incorrectly truncates files

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-4818: -- Fix Version/s: (was: 2.8.0) > AggregatedLogFormat.LogValue.write() incorrectly truncates files >

[jira] [Updated] (YARN-5007) MiniYarnCluster contains deprecated constructor which is called by the other constructors

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5007: -- Fix Version/s: (was: 2.8.0) Please do not set a fix version until the patch is committed. Thanks! >

[jira] [Updated] (YARN-4840) Add option to upload files recursively from container directory

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-4840: -- Fix Version/s: (was: 2.8.0) > Add option to upload files recursively from container directory > -

[jira] [Updated] (YARN-4420) Add REST API for List Reservations

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-4420: -- Fix Version/s: 3.0.0-alpha2 Reminder, please set a 3.x version when committing to trunk. Thanks! > Add R

[jira] [Updated] (YARN-4420) Add REST API for List Reservations

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-4420: -- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 Woops, looks like this was committ

[jira] [Updated] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-3139: -- Fix Version/s: 3.0.0-alpha2 > Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler > --

[jira] [Updated] (YARN-4205) Add a service for monitoring application life time out

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-4205: -- Fix Version/s: 3.0.0-alpha2 > Add a service for monitoring application life time out > --

[jira] [Updated] (YARN-3142) Improve locks in AppSchedulingInfo

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-3142: -- Fix Version/s: 3.0.0-alpha2 > Improve locks in AppSchedulingInfo > -- > >

[jira] [Updated] (YARN-3140) Improve locks in AbstractCSQueue/LeafQueue/ParentQueue

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-3140: -- Fix Version/s: 3.0.0-alpha2 > Improve locks in AbstractCSQueue/LeafQueue/ParentQueue > --

[jira] [Updated] (YARN-3141) Improve locks in SchedulerApplicationAttempt/FSAppAttempt/FiCaSchedulerApp

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-3141: -- Fix Version/s: 3.0.0-alpha2 > Improve locks in SchedulerApplicationAttempt/FSAppAttempt/FiCaSchedulerApp

[jira] [Updated] (YARN-4091) Add REST API to retrieve scheduler activity

2016-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-4091: -- Fix Version/s: 3.0.0-alpha2 > Add REST API to retrieve scheduler activity > -

[jira] [Commented] (YARN-5433) Audit dependencies for Category-X

2016-10-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596209#comment-15596209 ] Andrew Wang commented on YARN-5433: --- [~sjlee0] could you or someone else who worked on TS

[jira] [Commented] (YARN-5433) Audit dependencies for Category-X

2016-10-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596537#comment-15596537 ] Andrew Wang commented on YARN-5433: --- findbugs is the most glaring issue, but we should ch

[jira] [Updated] (YARN-5765) LinuxContainerExecutor creates appcache and its subdirectories with wrong group owner.

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5765: -- Target Version/s: 2.8.0, 3.0.0-alpha2 (was: 2.8.0) > LinuxContainerExecutor creates appcache and its sub

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606758#comment-15606758 ] Andrew Wang commented on YARN-4126: --- One little request, if we do revert this, let's plea

[jira] [Commented] (YARN-5184) Fix up incompatible changes introduced in YARN-2882 and YARN-5430

2016-10-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15613706#comment-15613706 ] Andrew Wang commented on YARN-5184: --- Karthik, could you summarize the incompatibilities f

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16246269#comment-16246269 ] Andrew Wang commented on YARN-7442: --- Hey, is this JIRA moving forwards? It's our last blo

[jira] [Commented] (YARN-7465) start-yarn.sh fails to start ResourceManager unless running as root

2017-11-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16246273#comment-16246273 ] Andrew Wang commented on YARN-7465: --- +1 thanks Sean! > start-yarn.sh fails to start Reso

[jira] [Updated] (YARN-7173) Container update RM-NM communication fix for backward compatibility

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7173: -- Fix Version/s: (was: 3.0.0) 3.0.0-beta1 > Container update RM-NM communication fix

[jira] [Updated] (YARN-6979) Add flag to notify all types of container updates to NM via NodeHeartbeatResponse

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6979: -- Fix Version/s: (was: 3.0.0) 3.0.0-beta1 > Add flag to notify all types of containe

[jira] [Updated] (YARN-6978) Add updateContainer API to NMClient.

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6978: -- Fix Version/s: (was: 3.0.0) 3.0.0-beta1 > Add updateContainer API to NMClient. > -

[jira] [Updated] (YARN-5978) ContainerScheduler and ContainerManager changes to support ExecType update

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5978: -- Fix Version/s: (was: 3.0.0) 3.0.0-beta1 > ContainerScheduler and ContainerManager

[jira] [Updated] (YARN-5977) ContainerManagementProtocol changes to support change of container ExecutionType

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5977: -- Fix Version/s: (was: 3.0.0) 3.0.0-beta1 > ContainerManagementProtocol changes to s

[jira] [Updated] (YARN-6849) NMContainerStatus should have the Container ExecutionType.

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6849: -- Fix Version/s: (was: 3.0.0) 3.0.0-beta1 > NMContainerStatus should have the Contai

[jira] [Commented] (YARN-6909) Use LightWeightedResource when number of resource types more than two

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16250423#comment-16250423 ] Andrew Wang commented on YARN-6909: --- I think the branch-3.0 commit was missed, I backport

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5959: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha2 > RM changes to support change of contain

[jira] [Updated] (YARN-5966) AMRMClient changes to support ExecutionType update

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5966: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha4 > AMRMClient changes to support Execution

[jira] [Updated] (YARN-5486) Update OpportunisticContainerAllocatorAMService::allocate method to handle OPPORTUNISTIC container requests

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5486: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha2 > Update OpportunisticContainerAllocatorA

[jira] [Updated] (YARN-5938) Refactoring OpportunisticContainerAllocator to use SchedulerRequestKey instead of Priority and other misc fixes

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5938: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha2 > Refactoring OpportunisticContainerAlloc

[jira] [Updated] (YARN-5833) Add validation to ensure default ports are unique in Configuration

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5833: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha2 > Add validation to ensure default ports

[jira] [Updated] (YARN-5799) Fix Opportunistic Allocation to set the correct value of Node Http Address

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5799: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha2 > Fix Opportunistic Allocation to set the

[jira] [Updated] (YARN-5457) Refactor DistributedScheduling framework to pull out common functionality

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5457: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Refactor DistributedScheduling framewor

[jira] [Updated] (YARN-5351) ResourceRequest should take ExecutionType into account during comparison

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5351: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > ResourceRequest should take ExecutionTy

[jira] [Updated] (YARN-5350) Distributed Scheduling: Ensure sort order of allocatable nodes returned by the RM is not lost

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5350: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Distributed Scheduling: Ensure sort ord

[jira] [Updated] (YARN-5180) Allow ResourceRequest to specify an enforceExecutionType flag

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5180: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Allow ResourceRequest to specify an enf

[jira] [Updated] (YARN-5212) Run existing ContainerManager tests using QueuingContainerManagerImpl

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5212: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Run existing ContainerManager tests usi

[jira] [Updated] (YARN-5204) Properly report status of killed/stopped queued containers

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5204: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Properly report status of killed/stoppe

[jira] [Updated] (YARN-5221) Expose UpdateResourceRequest API to allow AM to request for change in container properties

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5221: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha2 > Expose UpdateResourceRequest API to all

[jira] [Updated] (YARN-5127) Expose ExecutionType in Container api record

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5127: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Expose ExecutionType in Container api r

[jira] [Updated] (YARN-5176) More test cases for queuing of containers at the NM

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5176: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > More test cases for queuing of containe

[jira] [Updated] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5171: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Extend DistributedSchedulerProtocol to

[jira] [Updated] (YARN-5162) Fix Exceptions thrown during registerAM call when Distributed Scheduling is Enabled

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5162: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Fix Exceptions thrown during registerAM

[jira] [Updated] (YARN-5117) QueuingContainerManager does not start GUARANTEED Container even if Resources are available

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5117: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > QueuingContainerManager does not start

[jira] [Updated] (YARN-5113) Refactoring and other clean-up for distributed scheduling

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5113: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Refactoring and other clean-up for dist

[jira] [Updated] (YARN-5110) Fix OpportunisticContainerAllocator to insert complete HostAddress in issued ContainerTokenIds

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5110: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Fix OpportunisticContainerAllocator to

[jira] [Updated] (YARN-5090) Add End-to-End test-cases for DistributedScheduling using MiniYarnCluster

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5090: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Add End-to-End test-cases for Distribut

[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5124: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Modify AMRMClient to set the ExecutionT

[jira] [Updated] (YARN-2882) Add an OPPORTUNISTIC ExecutionType

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-2882: -- Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Add an OPPORTUNISTIC ExecutionType > --

[jira] [Updated] (YARN-5734) OrgQueue for easy CapacityScheduler queue configuration management

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5734: -- Fix Version/s: 3.0.0 2.9.0 > OrgQueue for easy CapacityScheduler queue configuration m

[jira] [Updated] (YARN-5734) OrgQueue for easy CapacityScheduler queue configuration management

2017-11-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5734: -- Release Note: The OrgQueue extension to the capacity scheduler provides a programmatic way to change c

[jira] [Updated] (YARN-7412) test_docker_util.test_check_mount_permitted() is failing

2017-11-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7412: -- Fix Version/s: 3.0.0 > test_docker_util.test_check_mount_permitted() is failing > ---

[jira] [Updated] (YARN-6789) Add Client API to get all supported resource types from RM

2017-11-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6789: -- Fix Version/s: (was: 3.1.0) 3.0.0 > Add Client API to get all supported resource t

[jira] [Updated] (YARN-6426) Compress ZK YARN keys to scale up (especially AppStateData

2017-11-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6426: -- Target Version/s: 3.1.0 (was: 3.0.0, 3.1.0) > Compress ZK YARN keys to scale up (especially AppStateData

[jira] [Updated] (YARN-6907) Node information page in the old web UI should report resource types

2017-11-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6907: -- Target Version/s: 3.1.0 (was: 3.0.0, 3.1.0) > Node information page in the old web UI should report reso

[jira] [Updated] (YARN-7342) Application page doesn't show correct metrics for reservation runs

2017-11-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7342: -- Target Version/s: 3.1.0 (was: 3.0.0, 3.1.0) > Application page doesn't show correct metrics for reservat

[jira] [Updated] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-11-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7190: -- Target Version/s: 3.1.0 (was: 3.0.0, 3.1.0) > Ensure only NM classpath in 2.x gets TSv2 related hbase ja

[jira] [Commented] (YARN-7430) Enable user re-mapping for Docker containers by default

2017-11-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16262776#comment-16262776 ] Andrew Wang commented on YARN-7430: --- Sure, please backport. Thanks for the attention Varu

[jira] [Commented] (YARN-7509) AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby

2017-11-24 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265407#comment-16265407 ] Andrew Wang commented on YARN-7509: --- Please put it in, thanks Wangda for your attention!

[jira] [Updated] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2017-12-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7461: -- Target Version/s: 3.1.0 (was: 3.0.0-alpha4) > DominantResourceCalculator#ratio calculation problem when

[jira] [Updated] (YARN-7471) queueUsagePercentage is wrongly calculated for applications in zero-capacity queues

2017-12-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7471: -- Target Version/s: 3.1.0 (was: 3.0.0-alpha4) > queueUsagePercentage is wrongly calculated for application

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16275205#comment-16275205 ] Andrew Wang commented on YARN-7590: --- Hi folks, is this a release blocker? Could someone s

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2017-12-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16275232#comment-16275232 ] Andrew Wang commented on YARN-7590: --- Thanks Eric! > Improve container-executor validatio

[jira] [Updated] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7610: -- Fix Version/s: (was: 3.0.0) 3.0.1 > Extend Distributed Shell to support launching

[jira] [Updated] (YARN-7611) Node manager web UI should display container type in containers page

2017-12-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7611: -- Fix Version/s: (was: 3.0.0) 3.0.1 > Node manager web UI should display container t

[jira] [Updated] (YARN-7513) Remove scheduler lock in FSAppAttempt.getWeight()

2017-12-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7513: -- Fix Version/s: (was: 3.0.0) 3.0.1 > Remove scheduler lock in FSAppAttempt.getWeigh

[jira] [Updated] (YARN-7524) Remove unused FairSchedulerEventLog

2017-12-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7524: -- Fix Version/s: (was: 3.0.0) 3.0.1 > Remove unused FairSchedulerEventLog >

[jira] [Commented] (YARN-7469) Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit

2017-12-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16284032#comment-16284032 ] Andrew Wang commented on YARN-7469: --- I pulled this into branch-3.0.0 as well, thanks folk

[jira] [Updated] (YARN-7390) All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.

2017-12-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7390: -- Fix Version/s: (was: 3.0.0) 3.0.1 > All reservation related test cases failed when

[jira] [Commented] (YARN-7290) Method canContainerBePreempted can return true when it shouldn't

2017-12-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16284035#comment-16284035 ] Andrew Wang commented on YARN-7290: --- I pulled this into branch-3.0.0 as well, thanks folk

[jira] [Commented] (YARN-7646) MR job (based on old version tarball) get failed due to incompatible resource request

2017-12-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16288572#comment-16288572 ] Andrew Wang commented on YARN-7646: --- At this point we just need to get 3.0.0 out, if ther

[jira] [Updated] (YARN-7646) MR job (based on old version tarball) get failed due to incompatible resource request

2017-12-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7646: -- Target Version/s: 3.0.1 (was: 3.0.0) > MR job (based on old version tarball) get failed due to incompati

[jira] [Updated] (YARN-7560) Resourcemanager hangs when resourceUsedWithWeightToResourceRatio return a overflow value

2017-12-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7560: -- Fix Version/s: (was: 3.0.0) 3.0.1 > Resourcemanager hangs when resourceUsedWithWe

[jira] [Updated] (YARN-6757) Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path

2017-07-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6757: -- Target Version/s: 3.0.0-beta1 (was: 3.0.0-alpha4) > Refactor the usage of > yarn.nodemanager.linux-cont

[jira] [Updated] (YARN-6771) Use classloader inside configuration class to make new classes

2017-07-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6771: -- Target Version/s: 3.0.0-beta1, 2.8.2 (was: 3.0.0-alpha4, 2.8.2) > Use classloader inside configuration c

[jira] [Commented] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2017-07-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16105617#comment-16105617 ] Andrew Wang commented on YARN-5464: --- Ping, is someone going to take this? Beta1 is fast a

<    1   2   3   4   >