[jira] [Commented] (YARN-10928) Support default queue properties of capacity scheduler to simplify configuration management

2021-09-07 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411357#comment-17411357 ] Weiwei Yang commented on YARN-10928: Sure, granted the contributor role to [~Weihao Zheng]. Thanks >

[jira] [Assigned] (YARN-10928) Support default queue properties of capacity scheduler to simplify configuration management

2021-09-07 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-10928: -- Assignee: Weihao Zheng > Support default queue properties of capacity scheduler to simplify

[jira] [Commented] (YARN-9050) [Umbrella] Usability improvements for scheduler activities

2020-03-13 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059095#comment-17059095 ] Weiwei Yang commented on YARN-9050: --- All done, marked resolved for 3.3.0. Thanks for the efforts [~Tao

[jira] [Resolved] (YARN-9050) [Umbrella] Usability improvements for scheduler activities

2020-03-13 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YARN-9050. --- Hadoop Flags: Reviewed Resolution: Fixed > [Umbrella] Usability improvements for scheduler

[jira] [Commented] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2020-03-13 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059094#comment-17059094 ] Weiwei Yang commented on YARN-9567: --- Thanks [~Tao Yang], looks good. +1 > Add diagnostics for

[jira] [Commented] (YARN-9538) Document scheduler/app activities and REST APIs

2020-03-13 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059090#comment-17059090 ] Weiwei Yang commented on YARN-9538: --- All looking good now. +1. > Document scheduler/app activities and

[jira] [Commented] (YARN-9050) [Umbrella] Usability improvements for scheduler activities

2020-03-13 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059089#comment-17059089 ] Weiwei Yang commented on YARN-9050: --- Thanks [~brahmareddy]. The patch was good but it was stuck there

[jira] [Commented] (YARN-9538) Document scheduler/app activities and REST APIs

2020-02-03 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029227#comment-17029227 ] Weiwei Yang commented on YARN-9538: --- Manually triggered the Jenkins job: 

[jira] [Commented] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2020-02-03 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029226#comment-17029226 ] Weiwei Yang commented on YARN-9567: --- Hi [~Tao Yang] Can you please rebase the patch to latest trunk? >

[jira] [Commented] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2020-02-03 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029223#comment-17029223 ] Weiwei Yang commented on YARN-9567: --- Thanks. Looks good. Somehow this latest patch did not trigger the

[jira] [Commented] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2020-01-09 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012075#comment-17012075 ] Weiwei Yang commented on YARN-9567: --- >  Not yet, I think it's not a strong requirement which only used

[jira] [Comment Edited] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2020-01-09 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012075#comment-17012075 ] Weiwei Yang edited comment on YARN-9567 at 1/9/20 5:50 PM: --- >  Not yet, I think

[jira] [Commented] (YARN-9538) Document scheduler/app activities and REST APIs

2020-01-09 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012069#comment-17012069 ] Weiwei Yang commented on YARN-9538: --- Hi [~Tao Yang] Thanks for the updates. Could you please also check

[jira] [Commented] (YARN-9538) Document scheduler/app activities and REST APIs

2020-01-08 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011477#comment-17011477 ] Weiwei Yang commented on YARN-9538: --- Hi [~Tao Yang] Few comments CS # The newly added document should

[jira] [Commented] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2020-01-08 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011437#comment-17011437 ] Weiwei Yang commented on YARN-9567: --- hi [~Tao Yang] The screenshots look good. I am not a UI expert,

[jira] [Commented] (YARN-10042) Uupgrade grpc-xxx depdencies to 1.26.0

2019-12-19 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000540#comment-17000540 ] Weiwei Yang commented on YARN-10042: +1, it looks good. [~tangzhankun] could you please help to

[jira] [Commented] (YARN-8737) Race condition in ParentQueue when reinitializing and sorting child queues in the meanwhile

2019-10-15 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951984#comment-16951984 ] Weiwei Yang commented on YARN-8737: --- Hi [~Tao Yang] Change LGTM, could you pls submit the patch? >

[jira] [Assigned] (YARN-9838) Using the CapacityScheduler,Apply "movetoqueue" on the application which CS reserved containers for,will cause "Num Container" and "Used Resource" in ResourceUsage metric

2019-10-13 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-9838: - Assignee: jiulongzhu > Using the CapacityScheduler,Apply "movetoqueue" on the application which

[jira] [Commented] (YARN-2255) YARN Audit logging not added to log4j.properties

2019-09-17 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-2255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931952#comment-16931952 ] Weiwei Yang commented on YARN-2255: --- I have committed this to trunk, 3.2 and 3.1. 3.0 is skipped because

[jira] [Commented] (YARN-2255) YARN Audit logging not added to log4j.properties

2019-09-17 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-2255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931947#comment-16931947 ] Weiwei Yang commented on YARN-2255: --- Sorry for the late response [~aihuaxu], this got slipped away from

[jira] [Commented] (YARN-2255) YARN Audit logging not added to log4j.properties

2019-09-10 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-2255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927261#comment-16927261 ] Weiwei Yang commented on YARN-2255: --- Thanks [~aihuaxu]. Patch LGTM. Thanks for putting it back on the

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2019-09-04 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922309#comment-16922309 ] Weiwei Yang commented on YARN-8995: --- Also looks good to me, [~Tao Yang], feel free to commit this. >

[jira] [Commented] (YARN-9538) Document scheduler/app activities and REST APIs

2019-08-29 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918495#comment-16918495 ] Weiwei Yang commented on YARN-9538: --- Hi [~Tao Yang] Can you please create MD files based on the google

[jira] [Updated] (YARN-9050) [Umbrella] Usability improvements for scheduler activities

2019-08-29 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9050: -- Fix Version/s: 3.3.0 > [Umbrella] Usability improvements for scheduler activities >

[jira] [Commented] (YARN-9664) Improve response of scheduler/app activities for better understanding

2019-08-29 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918472#comment-16918472 ] Weiwei Yang commented on YARN-9664: --- +1 committing now. Thanks [~Tao Yang] > Improve response of

[jira] [Commented] (YARN-9664) Improve response of scheduler/app activities for better understanding

2019-08-29 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918421#comment-16918421 ] Weiwei Yang commented on YARN-9664: --- UT seems not related to this patch, [~Tao Yang], could you please

[jira] [Commented] (YARN-9664) Improve response of scheduler/app activities for better understanding

2019-08-28 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918260#comment-16918260 ] Weiwei Yang commented on YARN-9664: --- Thanks [~Tao Yang]. For the single placement node, that is

[jira] [Commented] (YARN-9664) Improve response of scheduler/app activities for better understanding

2019-08-28 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16917798#comment-16917798 ] Weiwei Yang commented on YARN-9664: --- Hello [~Tao Yang] I just went through the patch. Most of the

[jira] [Commented] (YARN-9664) Improve response of scheduler/app activities for better understanding

2019-08-27 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16917421#comment-16917421 ] Weiwei Yang commented on YARN-9664: --- Just got time to take a look at this. Wow, this is a huge set of

[jira] [Comment Edited] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2019-08-20 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911501#comment-16911501 ] Weiwei Yang edited comment on YARN-8995 at 8/20/19 4:08 PM: Hi [~zhuqi]/[~Tao

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2019-08-20 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911501#comment-16911501 ] Weiwei Yang commented on YARN-8995: --- Hi [~zhuqi]/[~Tao Yang] Thanks for working on this. Patch LGTM, I

[jira] [Commented] (YARN-2599) Standby RM should also expose some jmx and metrics

2019-08-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909036#comment-16909036 ] Weiwei Yang commented on YARN-2599: --- LGTM, that minor check-style issue can be fixed during commit. +1.

[jira] [Commented] (YARN-9733) Method getCpuUsagePercent in Class ProcfsBasedProcessTree return 0 when subprocess of container dead

2019-08-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903612#comment-16903612 ] Weiwei Yang commented on YARN-9733: --- Sure, added you as a contributor, assigned this issue to you. Thx.

[jira] [Assigned] (YARN-9733) Method getCpuUsagePercent in Class ProcfsBasedProcessTree return 0 when subprocess of container dead

2019-08-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-9733: - Assignee: qian han > Method getCpuUsagePercent in Class ProcfsBasedProcessTree return 0 when >

[jira] [Commented] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2019-07-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893856#comment-16893856 ] Weiwei Yang commented on YARN-7621: --- [~cane], could you pls help to review [~Tao Yang]'s patch? Just

[jira] [Updated] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2019-07-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7621: -- Issue Type: Sub-task (was: Improvement) Parent: YARN-9698 > Support submitting apps with queue

[jira] [Updated] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler

2019-07-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9698: -- Labels: fs2cs (was: ) > [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler >

[jira] [Created] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler

2019-07-25 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-9698: - Summary: [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler Key: YARN-9698 URL: https://issues.apache.org/jira/browse/YARN-9698 Project: Hadoop

[jira] [Commented] (YARN-9687) Queue headroom check may let unacceptable allocation off when using DominantResourceCalculator

2019-07-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890170#comment-16890170 ] Weiwei Yang commented on YARN-9687: --- This is related to the core resource calculator, it would be good

[jira] [Commented] (YARN-9682) Wrong log message when finalizing the upgrade

2019-07-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886647#comment-16886647 ] Weiwei Yang commented on YARN-9682: --- Pushed to trunk, cherry-picked to branch-3.2 and branch-3.1. Thanks

[jira] [Updated] (YARN-9682) Wrong log message when finalizing the upgrade

2019-07-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9682: -- Fix Version/s: 3.1.3 > Wrong log message when finalizing the upgrade >

[jira] [Updated] (YARN-9682) Wrong log message when finalizing the upgrade

2019-07-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9682: -- Fix Version/s: 3.2.1 > Wrong log message when finalizing the upgrade >

[jira] [Updated] (YARN-9682) Wrong log message when finalizing the upgrade

2019-07-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9682: -- Summary: Wrong log message when finalizing the upgrade (was: wrong log message when finalize upgrade)

[jira] [Commented] (YARN-9682) wrong log message when finalize upgrade

2019-07-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886630#comment-16886630 ] Weiwei Yang commented on YARN-9682: --- +1, committing shortly. > wrong log message when finalize upgrade

[jira] [Commented] (YARN-9538) Document scheduler/app activities and REST APIs

2019-07-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881876#comment-16881876 ] Weiwei Yang commented on YARN-9538: --- Hi [~Tao Yang] I just read the v3 doc, it looks pretty good now.

[jira] [Commented] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2019-07-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877465#comment-16877465 ] Weiwei Yang commented on YARN-7621: --- cc [~leftnoteasy], [~sunilg], [~wilfreds]. This issue is important

[jira] [Updated] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2019-07-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7621: -- Priority: Major (was: Minor) > Support submitting apps with queue path for CapacityScheduler >

[jira] [Updated] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2019-07-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7621: -- Labels: fs2cs (was: ) > Support submitting apps with queue path for CapacityScheduler >

[jira] [Updated] (YARN-9658) Fix UT failures in TestLeafQueue

2019-07-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9658: -- Summary: Fix UT failures in TestLeafQueue (was: UT failures in TestLeafQueue) > Fix UT failures in

[jira] [Commented] (YARN-9658) UT failures in TestLeafQueue

2019-07-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877464#comment-16877464 ] Weiwei Yang commented on YARN-9658: --- +1 > UT failures in TestLeafQueue > >

[jira] [Updated] (YARN-9655) AllocateResponse in FederationInterceptor lost applicationPriority

2019-07-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9655: -- Fix Version/s: 2.9.3 > AllocateResponse in FederationInterceptor lost applicationPriority >

[jira] [Updated] (YARN-9655) AllocateResponse in FederationInterceptor lost applicationPriority

2019-07-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9655: -- Fix Version/s: 3.0.4 > AllocateResponse in FederationInterceptor lost applicationPriority >

[jira] [Commented] (YARN-9655) AllocateResponse in FederationInterceptor lost applicationPriority

2019-07-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876632#comment-16876632 ] Weiwei Yang commented on YARN-9655: --- Thanks [~hunhun], re-opened the issue to trigger jenkins job. >

[jira] [Reopened] (YARN-9655) AllocateResponse in FederationInterceptor lost applicationPriority

2019-07-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reopened YARN-9655: --- > AllocateResponse in FederationInterceptor lost applicationPriority >

[jira] [Commented] (YARN-9655) AllocateResponse in FederationInterceptor lost applicationPriority

2019-07-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876620#comment-16876620 ] Weiwei Yang commented on YARN-9655: --- I just pushed this to trunk, cherry-picked to branch-3.2,

[jira] [Updated] (YARN-9655) AllocateResponse in FederationInterceptor lost applicationPriority

2019-07-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9655: -- Fix Version/s: 3.1.3 > AllocateResponse in FederationInterceptor lost applicationPriority >

[jira] [Updated] (YARN-9655) AllocateResponse in FederationInterceptor lost applicationPriority

2019-07-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9655: -- Fix Version/s: 3.2.1 > AllocateResponse in FederationInterceptor lost applicationPriority >

[jira] [Resolved] (YARN-9655) AllocateResponse in FederationInterceptor lost applicationPriority

2019-07-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YARN-9655. --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.3.0 > AllocateResponse in

[jira] [Commented] (YARN-9623) Auto adjust max queue length of app activities to make sure activities on all nodes can be covered

2019-07-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875986#comment-16875986 ] Weiwei Yang commented on YARN-9623: --- Hi [~Tao Yang], pls create a new issue to fix this failure. Thanks

[jira] [Commented] (YARN-9655) AllocateResponse in FederationInterceptor lost applicationPriority

2019-06-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875037#comment-16875037 ] Weiwei Yang commented on YARN-9655: --- Oops. The fix was simple and that makes me ignore there is no UT

[jira] [Commented] (YARN-9655) AllocateResponse in FederationInterceptor lost applicationPriority

2019-06-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875035#comment-16875035 ] Weiwei Yang commented on YARN-9655: --- +1. committing shortly. > AllocateResponse in

[jira] [Assigned] (YARN-9655) AllocateResponse in FederationInterceptor lost applicationPriority

2019-06-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-9655: - Assignee: hunshenshi > AllocateResponse in FederationInterceptor lost applicationPriority >

[jira] [Commented] (YARN-9623) Auto adjust max queue length of app activities to make sure activities on all nodes can be covered

2019-06-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874994#comment-16874994 ] Weiwei Yang commented on YARN-9623: --- Pushed to trunk, thanks for the contribution [~Tao Yang]. > Auto

[jira] [Commented] (YARN-9623) Auto adjust max queue length of app activities to make sure activities on all nodes can be covered

2019-06-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874991#comment-16874991 ] Weiwei Yang commented on YARN-9623: --- +1, committing shortly. > Auto adjust max queue length of app

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2019-06-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874571#comment-16874571 ] Weiwei Yang commented on YARN-6629: --- Hi [~aihuaxu], that's correct, this will be included in 2.10. But

[jira] [Commented] (YARN-9655) AllocateResponse in FederationInterceptor lost applicationPriority

2019-06-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874185#comment-16874185 ] Weiwei Yang commented on YARN-9655: --- LGTM. Not sure if this can get some folks familiar with this to

[jira] [Commented] (YARN-9642) AbstractYarnScheduler#clearPendingContainerCache could run even after transitiontostandby

2019-06-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874181#comment-16874181 ] Weiwei Yang commented on YARN-9642: --- Sorry for getting to this late. It's a good catch,  +1. Thanks

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2019-06-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874176#comment-16874176 ] Weiwei Yang commented on YARN-6629: --- hi [~aihuaxu], [~Tao Yang] Feel free to create another Jira for

[jira] [Commented] (YARN-9623) Auto adjust max queue length of app activities to make sure activities on all nodes can be covered

2019-06-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874168#comment-16874168 ] Weiwei Yang commented on YARN-9623: --- Hi [~Tao Yang] OK, I am fine with that. However, we still need to

[jira] [Commented] (YARN-9623) Auto adjust max queue length of app activities to make sure activities on all nodes can be covered

2019-06-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873966#comment-16873966 ] Weiwei Yang commented on YARN-9623: --- Hi [~Tao Yang] Generally, I think this is a good approach, to have

[jira] [Commented] (YARN-9451) AggregatedLogsBlock shows wrong NM http port

2019-06-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16871431#comment-16871431 ] Weiwei Yang commented on YARN-9451: --- Thanks. Patch LGTM, I guess that to use the HTTP port is better for

[jira] [Commented] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-06-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16869361#comment-16869361 ] Weiwei Yang commented on YARN-9209: --- Thanks [~tarunparimi]. I just committed this to trunk and

[jira] [Updated] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-06-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9209: -- Fix Version/s: 3.2.1 > When nodePartition is not set in Placement Constraints, containers are >

[jira] [Commented] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-06-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16869342#comment-16869342 ] Weiwei Yang commented on YARN-9209: --- Agree. +1 for this patch, let's get this issue fixed first. For

[jira] [Commented] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-06-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16869275#comment-16869275 ] Weiwei Yang commented on YARN-9209: --- Hi [~tarunparimi] Sorry, it's been a while. My understanding is

[jira] [Commented] (YARN-9634) Make yarn submit dir and log aggregation dir more evenly distributed

2019-06-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16869268#comment-16869268 ] Weiwei Yang commented on YARN-9634: --- Hi [~zhuqi] Thanks. Are you suggesting to let parameter

[jira] [Commented] (YARN-9634) Make yarn submit dir and log aggregation dir more evenly distributed

2019-06-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868547#comment-16868547 ] Weiwei Yang commented on YARN-9634: --- Hi [~zhuqi] what do you mean by the default storage limit, is that

[jira] [Commented] (YARN-9621) FIX TestDSWithMultipleNodeManager.testDistributedShellWithPlacementConstraint on branch-3.1

2019-06-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16865465#comment-16865465 ] Weiwei Yang commented on YARN-9621: --- Thanks [~Prabhu Joseph], [~pbacsko]. the fix LGTM, committing this

[jira] [Commented] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2019-06-12 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862697#comment-16862697 ] Weiwei Yang commented on YARN-9567: --- Hi [~Tao Yang] I will take a look at this later this week. Will

[jira] [Commented] (YARN-9578) Add limit/actions/summarize options for app activities REST API

2019-06-12 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862658#comment-16862658 ] Weiwei Yang commented on YARN-9578: --- Thanks [~Tao Yang] for the updates, it looks good to me now. +1 for

[jira] [Updated] (YARN-9578) Add limit/actions/summarize options for app activities REST API

2019-06-12 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9578: -- Hadoop Flags: Incompatible change > Add limit/actions/summarize options for app activities REST API >

[jira] [Commented] (YARN-9578) Add limit/actions/summarize options for app activities REST API

2019-06-12 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16861949#comment-16861949 ] Weiwei Yang commented on YARN-9578: --- Thanks [~Tao Yang]. I see, then it's fine, given subList won't have

[jira] [Commented] (YARN-9598) Make reservation work well when multi-node enabled

2019-06-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860157#comment-16860157 ] Weiwei Yang commented on YARN-9598: --- Thanks for bringing this up and the discussions. It looks like the

[jira] [Commented] (YARN-9598) Make reservation work well when multi-node enabled

2019-06-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857545#comment-16857545 ] Weiwei Yang commented on YARN-9598: --- Ping [~jutia], may you help to take a look too? Thanks > Make

[jira] [Commented] (YARN-9578) Add limit/actions/summarize options for app activities REST API

2019-06-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857544#comment-16857544 ] Weiwei Yang commented on YARN-9578: --- Hi [~Tao Yang] For limit option, I was referring to this code

[jira] [Commented] (YARN-9590) Correct incompatible, incomplete and redundant activities

2019-06-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857541#comment-16857541 ] Weiwei Yang commented on YARN-9590: --- Sure, make sense to me. LGTM, +1. I'll commit shortly. > Correct

[jira] [Commented] (YARN-9590) Correct incompatible, incomplete and redundant activities

2019-06-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857513#comment-16857513 ] Weiwei Yang commented on YARN-9590: --- Hi [~Tao Yang] Thanks, good cleanup, and fixes. Just one thing

[jira] [Commented] (YARN-9578) Add limit/actions/summarize options for app activities REST API

2019-06-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857495#comment-16857495 ] Weiwei Yang commented on YARN-9578: --- Hi [~Tao Yang] Thanks for the patch. A few comments here 1.

[jira] [Commented] (YARN-9600) Support self-adaption width for columns of containers table on app attempt page

2019-06-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856371#comment-16856371 ] Weiwei Yang commented on YARN-9600: --- Thanks [~akhilpb] for the additional review, I'll help to commit

[jira] [Commented] (YARN-9600) Support self-adaption width for columns of containers table on app attempt page

2019-06-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16855649#comment-16855649 ] Weiwei Yang commented on YARN-9600: --- Ping [~akhilpb], would you please help to review this patch? Thx >

[jira] [Commented] (YARN-9580) Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers

2019-06-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16855277#comment-16855277 ] Weiwei Yang commented on YARN-9580: --- Hi [~Tao Yang] There seems to have issues in the patch for

[jira] [Reopened] (YARN-9580) Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers

2019-06-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reopened YARN-9580: --- > Fulfilled reservation information in assignment is lost when transferring in >

[jira] [Commented] (YARN-9580) Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers

2019-06-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854701#comment-16854701 ] Weiwei Yang commented on YARN-9580: --- Committed to trunk. [~Tao Yang], can you please provide a patch for

[jira] [Commented] (YARN-9580) Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers

2019-06-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854697#comment-16854697 ] Weiwei Yang commented on YARN-9580: --- [~Tao Yang], thanks for the patch, it makes sense to me. +1. >

[jira] [Commented] (YARN-9507) Fix NPE in NodeManager#serviceStop on startup failure

2019-06-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854265#comment-16854265 ] Weiwei Yang commented on YARN-9507: --- Committed to trunk, cherry-picked to branch-3.2 and branch-3.1. >

[jira] [Updated] (YARN-9507) Fix NPE in NodeManager#serviceStop on startup failure

2019-06-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9507: -- Fix Version/s: 3.1.3 > Fix NPE in NodeManager#serviceStop on startup failure >

[jira] [Updated] (YARN-9507) Fix NPE in NodeManager#serviceStop on startup failure

2019-06-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9507: -- Fix Version/s: 3.2.1 > Fix NPE in NodeManager#serviceStop on startup failure >

[jira] [Commented] (YARN-9507) Fix NPE in NodeManager#serviceStop on startup failure

2019-06-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854246#comment-16854246 ] Weiwei Yang commented on YARN-9507: --- LGTM, +1. Committing shortly. > Fix NPE in NodeManager#serviceStop

[jira] [Commented] (YARN-9538) Document scheduler/app activities and REST APIs

2019-05-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852032#comment-16852032 ] Weiwei Yang commented on YARN-9538: --- Hi [~Tao Yang] Thanks for the updates in doc template, it looks

[jira] [Comment Edited] (YARN-8693) Add signalToContainer REST API for RMWebServices

2019-05-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16850619#comment-16850619 ] Weiwei Yang edited comment on YARN-8693 at 5/29/19 8:34 AM: Hi [~Tao Yang]

  1   2   3   4   5   6   7   8   9   10   >