[jira] [Updated] (YARN-854) App submission fails on secure deploy

[ https://issues.apache.org/jira/browse/YARN-854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-854: - Attachment: YARN-854-branch-2.0.6.patch Attaching fix for branch 2.0. Could somebody

[jira] [Commented] (YARN-854) App submission fails on secure deploy

[ https://issues.apache.org/jira/browse/YARN-854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13723232#comment-13723232 ] Konstantin Shvachko commented on YARN-854: -- Aaron thanks for the review. The

[jira] [Commented] (YARN-854) App submission fails on secure deploy

[ https://issues.apache.org/jira/browse/YARN-854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724214#comment-13724214 ] Konstantin Shvachko commented on YARN-854: -- Committed to branch 2.0.6.

[jira] [Updated] (YARN-3255) RM and NM main() should support generic options

[ https://issues.apache.org/jira/browse/YARN-3255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-3255: -- Attachment: YARN-3255-02.patch Added {{GenericOptionsParser}} to {{WebAppProxyServer}}

[jira] [Updated] (YARN-3255) RM and NM main() should support generic options

[ https://issues.apache.org/jira/browse/YARN-3255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-3255: -- Attachment: YARN-3255-01.patch A simple patch, which particularly lets me run a Yarn

[jira] [Created] (YARN-3255) RM and NM main() should support generic options

Konstantin Shvachko created YARN-3255: - Summary: RM and NM main() should support generic options Key: YARN-3255 URL: https://issues.apache.org/jira/browse/YARN-3255 Project: Hadoop YARN

[jira] [Resolved] (YARN-3255) RM, NM, JobHistoryServer, and WebAppProxyServer's main() should support generic options

[ https://issues.apache.org/jira/browse/YARN-3255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved YARN-3255. --- Resolution: Fixed Fix Version/s: 2.7.0 I just committed this. Thank you guys

[jira] [Updated] (YARN-3255) RM, NM, JobHistoryServer, and WebAppProxyServer's main() should support generic options

[ https://issues.apache.org/jira/browse/YARN-3255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-3255: -- Attachment: YARN-3255-branch-2.patch Patch for branch-2. Minor difference in import

[jira] [Updated] (YARN-6818) User limit per partition is not honored in branch-2.7 >=

[ https://issues.apache.org/jira/browse/YARN-6818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-6818: -- Labels: (was: release-blocker) > User limit per partition is not honored in branch-2.7

[jira] [Updated] (YARN-6698) Backport YARN-5121 to branch-2.7

[ https://issues.apache.org/jira/browse/YARN-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-6698: -- Fix Version/s: (was: 2.7.4) > Backport YARN-5121 to branch-2.7 >

[jira] [Updated] (YARN-6728) Job will run slow when the performance of defaultFs degrades and the log-aggregation is enable.

[ https://issues.apache.org/jira/browse/YARN-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-6728: -- Fix Version/s: (was: 2.7.4) (was: 2.9.0) > Job will run slow

[jira] [Updated] (YARN-6568) A queue which runs a long time job couldn't acquire any container for long time.

[ https://issues.apache.org/jira/browse/YARN-6568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-6568: -- Fix Version/s: (was: 2.7.4) > A queue which runs a long time job couldn't acquire

[jira] [Updated] (YARN-6002) Range support when serving a container log

[ https://issues.apache.org/jira/browse/YARN-6002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-6002: -- Fix Version/s: (was: 2.7.4) > Range support when serving a container log >

[jira] [Updated] (YARN-5543) ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread

[ https://issues.apache.org/jira/browse/YARN-5543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-5543: -- Labels: oct16-medium (was: oct16-medium release-blocker) > ResourceManager

[jira] [Commented] (YARN-5543) ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread

[ https://issues.apache.org/jira/browse/YARN-5543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007117#comment-16007117 ] Konstantin Shvachko commented on YARN-5543: --- In the new test could you guys make sure that {{rm}}

[jira] [Updated] (YARN-5121) fix some container-executor portability issues

[ https://issues.apache.org/jira/browse/YARN-5121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-5121: -- Target Version/s: 3.0.0-alpha2, 2.7.4 (was: 2.7.4, 3.0.0-alpha2) Labels:

[jira] [Commented] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018960#comment-16018960 ] Konstantin Shvachko commented on YARN-1471: --- Hey [~zhouyejoe] or [~chris.douglas] do you mind

[jira] [Updated] (YARN-4612) Fix rumen and scheduler load simulator handle killed tasks properly

[ https://issues.apache.org/jira/browse/YARN-4612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-4612: -- Labels: (was: release-blocker) Fix Version/s: 2.8.2 2.7.4

[jira] [Updated] (YARN-4109) Exception on RM scheduler page loading with labels

[ https://issues.apache.org/jira/browse/YARN-4109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-4109: -- Labels: (was: release-blocker) Fix Version/s: 2.7.4 Just committed this to

[jira] [Commented] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16032448#comment-16032448 ] Konstantin Shvachko commented on YARN-1471: --- Hey guys. Let's target full SLS feature for the next

[jira] [Commented] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035595#comment-16035595 ] Konstantin Shvachko commented on YARN-1471: --- I see a new patch in YARN-6608. So this is

[jira] [Updated] (YARN-5988) RM unable to start in secure setup

[ https://issues.apache.org/jira/browse/YARN-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-5988: -- Labels: (was: release-blocker) > RM unable to start in secure setup >

[jira] [Commented] (YARN-5988) RM unable to start in secure setup

[ https://issues.apache.org/jira/browse/YARN-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036377#comment-16036377 ] Konstantin Shvachko commented on YARN-5988: --- OK, great! Could you please replace my patches with

[jira] [Commented] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035723#comment-16035723 ] Konstantin Shvachko commented on YARN-4140: --- The backport patch looks good. Minor nits in

[jira] [Commented] (YARN-4925) ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression

[ https://issues.apache.org/jira/browse/YARN-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16031876#comment-16031876 ] Konstantin Shvachko commented on YARN-4925: --- I've done quite a few runs for the client tests. I

[jira] [Updated] (YARN-4250) NPE in AppSchedulingInfo#isRequestLabelChanged

[ https://issues.apache.org/jira/browse/YARN-4250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-4250: -- Labels: (was: release-blocker) Fix Version/s: 2.7.4 I just committed this

[jira] [Updated] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-4140: -- Labels: (was: release-blocker) > RM container allocation delayed incase of app

[jira] [Updated] (YARN-5988) RM unable to start in secure setup

[ https://issues.apache.org/jira/browse/YARN-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-5988: -- Attachment: YARN-5988-branch-2.8.05.patch YARN-5988-branch-2.7.05.patch

[jira] [Updated] (YARN-4925) ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression

[ https://issues.apache.org/jira/browse/YARN-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-4925: -- Labels: (was: release-blocker) Fix Version/s: 2.7.4 Just committed this to

[jira] [Commented] (YARN-4925) ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression

[ https://issues.apache.org/jira/browse/YARN-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035651#comment-16035651 ] Konstantin Shvachko commented on YARN-4925: --- Turned out the *Client tests were failing due to

[jira] [Updated] (YARN-5988) RM unable to start in secure setup

[ https://issues.apache.org/jira/browse/YARN-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-5988: -- Attachment: (was: YARN-5988-branch-2.8.05.patch) > RM unable to start in secure

[jira] [Updated] (YARN-5988) RM unable to start in secure setup

[ https://issues.apache.org/jira/browse/YARN-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-5988: -- Attachment: YARN-5988-branch-2.8.0001.patch > RM unable to start in secure setup >

[jira] [Updated] (YARN-4109) Exception on RM scheduler page loading with labels

[ https://issues.apache.org/jira/browse/YARN-4109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-4109: -- Target Version/s: 2.7.4 Labels: release-blocker (was: ) > Exception on RM

[jira] [Updated] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-4140: -- Target Version/s: 2.7.4 (was: 2.7.3) Labels: release-blocker (was: ) >

[jira] [Updated] (YARN-4250) NPE in AppSchedulingInfo#isRequestLabelChanged

[ https://issues.apache.org/jira/browse/YARN-4250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-4250: -- Target Version/s: 2.7.4 Labels: release-blocker (was: ) > NPE in

[jira] [Updated] (YARN-4925) ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression

[ https://issues.apache.org/jira/browse/YARN-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-4925: -- Target Version/s: 2.7.4 Labels: release-blocker (was: ) >

[jira] [Updated] (YARN-4302) SLS not able start due to NPE in SchedulerApplicationAttempt#getResourceUsageReport

[ https://issues.apache.org/jira/browse/YARN-4302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-4302: -- Target Version/s: 2.7.4 Labels: release-blocker (was: ) > SLS not able

[jira] [Updated] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-1471: -- Target Version/s: 2.7.4 Labels: release-blocker (was: ) > The SLS

[jira] [Updated] (YARN-4367) SLS webapp doesn't load

[ https://issues.apache.org/jira/browse/YARN-4367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-4367: -- Labels: release-blocker (was: ) Fix Version/s: 2.7.4 > SLS webapp doesn't

[jira] [Updated] (YARN-4367) SLS webapp doesn't load

[ https://issues.apache.org/jira/browse/YARN-4367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-4367: -- Target Version/s: 2.8.0, 2.7.4 (was: 2.8.0) Fix Version/s: (was: 2.7.4) >

[jira] [Updated] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

[ https://issues.apache.org/jira/browse/YARN-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-4771: -- Priority: Major (was: Critical) Changing to Major to remove from the scope of 2.7.4

[jira] [Updated] (YARN-4612) Fix rumen and scheduler load simulator handle killed tasks properly

[ https://issues.apache.org/jira/browse/YARN-4612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-4612: -- Target Version/s: 2.7.4 Labels: release-blocker (was: ) > Fix rumen and

[jira] [Updated] (YARN-4367) SLS webapp doesn't load

[ https://issues.apache.org/jira/browse/YARN-4367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-4367: -- Labels: (was: release-blocker) Fix Version/s: 2.7.4 I just committed this

[jira] [Updated] (YARN-4302) SLS not able start due to NPE in SchedulerApplicationAttempt#getResourceUsageReport

[ https://issues.apache.org/jira/browse/YARN-4302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-4302: -- Labels: (was: release-blocker) Fix Version/s: 2.7.4 I just committed this

[jira] [Commented] (YARN-4925) ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression

[ https://issues.apache.org/jira/browse/YARN-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018974#comment-16018974 ] Konstantin Shvachko commented on YARN-4925: --- Hey [~jhung] looks like there are problems with a

[jira] [Comment Edited] (YARN-4925) ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression

[ https://issues.apache.org/jira/browse/YARN-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018974#comment-16018974 ] Konstantin Shvachko edited comment on YARN-4925 at 5/21/17 8:27 PM: Hey

[jira] [Commented] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16032114#comment-16032114 ] Konstantin Shvachko commented on YARN-4140: --- Hey [~bibinchundatt] did you want to work on porting

[jira] [Updated] (YARN-5333) Some recovered apps are put into default queue when RM HA

[ https://issues.apache.org/jira/browse/YARN-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-5333: -- Labels: (was: release-blocker) > Some recovered apps are put into default queue when

[jira] [Updated] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-1471: -- Labels: (was: release-blocker) Fix Version/s: 2.8.2 2.7.4

[jira] [Updated] (YARN-3687) We should be able to remove node-label if there's no queue can use it.

[ https://issues.apache.org/jira/browse/YARN-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-3687: -- Target Version/s: (was: 2.7.5) > We should be able to remove node-label if there's no

[jira] [Commented] (YARN-6632) Backport YARN-3425 to branch 2.7

[ https://issues.apache.org/jira/browse/YARN-6632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295727#comment-16295727 ] Konstantin Shvachko commented on YARN-6632: --- Hey [~elgoiri] can you change the status to "Patch

[jira] [Updated] (YARN-6632) Backport YARN-3425 to branch 2.7

[ https://issues.apache.org/jira/browse/YARN-6632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-6632: -- Issue Type: Bug (was: Task) > Backport YARN-3425 to branch 2.7 >

[jira] [Updated] (YARN-6959) RM may allocate wrong AM Container for new attempt

[ https://issues.apache.org/jira/browse/YARN-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-6959: -- Fix Version/s: (was: 2.7.1) 2.7.5 > RM may allocate wrong AM

[jira] [Commented] (YARN-8200) Backport resource types/GPU features to branch-2

[ https://issues.apache.org/jira/browse/YARN-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461622#comment-16461622 ] Konstantin Shvachko commented on YARN-8200: --- Hey guys I rebased branch YARN-8200 onto branch-2

[jira] [Commented] (YARN-8200) Backport resource types/GPU features to branch-2

[ https://issues.apache.org/jira/browse/YARN-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459363#comment-16459363 ] Konstantin Shvachko commented on YARN-8200: --- [~sunilg], thanks for the hints on the benchmarks.

[jira] [Updated] (YARN-4167) NPE on RMActiveServices#serviceStop when store is null

[ https://issues.apache.org/jira/browse/YARN-4167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-4167: -- Fix Version/s: 2.7.6 > NPE on RMActiveServices#serviceStop when store is null >

[jira] [Updated] (YARN-3425) NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed

[ https://issues.apache.org/jira/browse/YARN-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-3425: -- Fix Version/s: 2.7.6 > NPE from RMNodeLabelsManager.serviceStop when

[jira] [Commented] (YARN-8200) Backport resource types/GPU features to branch-2

[ https://issues.apache.org/jira/browse/YARN-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603634#comment-16603634 ] Konstantin Shvachko commented on YARN-8200: --- I was trying to build YARN-8200 branch with this

[jira] [Closed] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko closed YARN-7249. - > Fix CapacityScheduler NPE issue when a container preempted while the node is > being

[jira] [Commented] (YARN-8200) Backport resource types/GPU features to branch-2

[ https://issues.apache.org/jira/browse/YARN-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451384#comment-16451384 ] Konstantin Shvachko commented on YARN-8200: --- What people think if we create a branch so that

[jira] [Commented] (YARN-8200) Backport resource types/GPU features to branch-2

[ https://issues.apache.org/jira/browse/YARN-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449000#comment-16449000 ] Konstantin Shvachko commented on YARN-8200: --- Hey [~leftnoteasy], we discussed it in [this

[jira] [Resolved] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved YARN-7249. --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.6 Just

[jira] [Commented] (YARN-8200) Backport resource types/GPU features to branch-2

[ https://issues.apache.org/jira/browse/YARN-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16453121#comment-16453121 ] Konstantin Shvachko commented on YARN-8200: --- Cut a branch for this jira out of branch-2.9.