[jira] [Created] (YARN-8969) Change the return type to generic type of AbstractYarnScheduler#getNodeTracker

2018-11-05 Thread Wanqiang Ji (JIRA)
Wanqiang Ji created YARN-8969: - Summary: Change the return type to generic type of AbstractYarnScheduler#getNodeTracker Key: YARN-8969 URL: https://issues.apache.org/jira/browse/YARN-8969 Project: Hadoop

[jira] [Updated] (YARN-8969) Change the return type to generic type of AbstractYarnScheduler#getNodeTracker

2018-11-05 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-8969: -- Attachment: YARN-8969.001.patch > Change the return type to generic type of

[jira] [Commented] (YARN-8969) Change the return type to generic type of AbstractYarnScheduler#getNodeTracker

2018-11-05 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675266#comment-16675266 ] Wanqiang Ji commented on YARN-8969: --- [~kasha] [~cheersyang] Can you help review this? thx~ > Change the

[jira] [Commented] (YARN-8969) Change the return type to generic type of AbstractYarnScheduler#getNodeTracker

2018-11-05 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675287#comment-16675287 ] Wanqiang Ji commented on YARN-8969: --- Thanks [~cheersyang] review this. > Change the return type to

[jira] [Updated] (YARN-8977) Remove explicit type when called AbstractYarnScheduler#getSchedulerNode to avoid type casting

2018-11-06 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-8977: -- Attachment: YARN-8977.002.patch > Remove explicit type when called

[jira] [Commented] (YARN-8977) Remove explicit type when called AbstractYarnScheduler#getSchedulerNode to avoid type casting

2018-11-06 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677599#comment-16677599 ] Wanqiang Ji commented on YARN-8977: --- Hi [~cheersyang] The patch updated. Pending on Jenkins. I'm so

[jira] [Updated] (YARN-9004) Remove unnecessary modifier for interface belong to scheduler

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9004: -- Attachment: YARN-9004.001.patch > Remove unnecessary modifier for interface belong to scheduler >

[jira] [Issue Comment Deleted] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9005: -- Comment: was deleted (was: [~wilfreds] Can you help to review this? thx) > FairScheduler maybe preempt

[jira] [Commented] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682199#comment-16682199 ] Wanqiang Ji commented on YARN-9005: --- Hi [~cheersyang], Happy Weekend! Can you help to review this? This

[jira] [Comment Edited] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682199#comment-16682199 ] Wanqiang Ji edited comment on YARN-9005 at 11/10/18 4:30 AM: - Hi 

[jira] [Commented] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682200#comment-16682200 ] Wanqiang Ji commented on YARN-9005: --- [~wilfreds] Can you help to review this? thx > FairScheduler maybe

[jira] [Updated] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9005: -- Attachment: (was: YARN-9005.002.patch) > FairScheduler maybe preempt the AM container >

[jira] [Updated] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9005: -- Issue Type: Bug (was: Improvement) > FairScheduler maybe preempt the AM container >

[jira] [Created] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Wanqiang Ji (JIRA)
Wanqiang Ji created YARN-9005: - Summary: FairScheduler maybe preempt the AM container Key: YARN-9005 URL: https://issues.apache.org/jira/browse/YARN-9005 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682251#comment-16682251 ] Wanqiang Ji commented on YARN-9005: --- Thanks [~yufeigu] provides the original design and discussion. I

[jira] [Created] (YARN-9004) Remove unnecessary modifier for interface belong to scheduler

2018-11-09 Thread Wanqiang Ji (JIRA)
Wanqiang Ji created YARN-9004: - Summary: Remove unnecessary modifier for interface belong to scheduler Key: YARN-9004 URL: https://issues.apache.org/jira/browse/YARN-9004 Project: Hadoop YARN

[jira] [Updated] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9005: -- Attachment: YARN-9005.002.patch > FairScheduler maybe preempt the AM container >

[jira] [Commented] (YARN-9004) Remove unnecessary modifier for interface belong to scheduler

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682184#comment-16682184 ] Wanqiang Ji commented on YARN-9004: --- Hi [~cheersyang], Happy Weekend! Can you help to review this? This

[jira] [Updated] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9005: -- Attachment: YARN-9005.002.patch > FairScheduler maybe preempt the AM container >

[jira] [Comment Edited] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-10 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682251#comment-16682251 ] Wanqiang Ji edited comment on YARN-9005 at 11/10/18 8:29 AM: - Thanks

[jira] [Commented] (YARN-9004) Remove unnecessary modifier for interface belong to scheduler

2018-11-15 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16688969#comment-16688969 ] Wanqiang Ji commented on YARN-9004: --- Hi  [~cheersyang], [~eyang]  Although there is no functional

[jira] [Commented] (YARN-9004) Remove unnecessary modifier for interface belong to scheduler

2018-11-15 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689042#comment-16689042 ] Wanqiang Ji commented on YARN-9004: --- Hi [~cheersyang]  Thanks for your answer, let me know more about

[jira] [Updated] (YARN-9004) Remove unnecessary modifier for interface belong to scheduler

2018-11-15 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9004: -- Affects Version/s: 2.9.1 3.1.1 3.0.3 > Remove unnecessary

[jira] [Commented] (YARN-8977) Remove explicit type when called AbstractYarnScheduler#getSchedulerNode to avoid type casting

2018-11-07 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678065#comment-16678065 ] Wanqiang Ji commented on YARN-8977: --- I don't think the hadoop-yarn-server-resourcemanager issues are

[jira] [Commented] (YARN-8969) Change the return type to generic type of AbstractYarnScheduler#getNodeTracker

2018-11-05 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676148#comment-16676148 ] Wanqiang Ji commented on YARN-8969: --- Thanks [~eepayne] [~yufeigu] to watch this and works. Except

[jira] [Comment Edited] (YARN-8969) AbstractYarnScheduler#getNodeTracker should return generic type to avoid type casting

2018-11-05 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676148#comment-16676148 ] Wanqiang Ji edited comment on YARN-8969 at 11/6/18 5:14 AM: Thanks [~eepayne]

[jira] [Created] (YARN-8977) Remove explicit type when called AbstractYarnScheduler#getSchedulerNode to avoid type casting

2018-11-06 Thread Wanqiang Ji (JIRA)
Wanqiang Ji created YARN-8977: - Summary: Remove explicit type when called AbstractYarnScheduler#getSchedulerNode to avoid type casting Key: YARN-8977 URL: https://issues.apache.org/jira/browse/YARN-8977

[jira] [Commented] (YARN-8977) Remove explicit type when called AbstractYarnScheduler#getSchedulerNode to avoid type casting

2018-11-06 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676796#comment-16676796 ] Wanqiang Ji commented on YARN-8977: --- [~kasha], [~cheersyang] Can you help to review this? thx~ This

[jira] [Commented] (YARN-8977) Remove unnecessary type casting when calling AbstractYarnScheduler#getSchedulerNode

2018-11-07 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678349#comment-16678349 ] Wanqiang Ji commented on YARN-8977: --- Thanks for your review and works [~cheersyang] > Remove

[jira] [Updated] (YARN-8996) [Submarine] Simplify the logic in YarnServiceJobSubmitter#needHdfs

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-8996: -- Description: In YarnServiceJobSubmitter#needHdfs. Below code can be simplified to just one line.

[jira] [Updated] (YARN-8996) [Submarine] Simplify the logic in YarnServiceJobSubmitter#needHdfs

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-8996: -- Environment: (was: In YarnServiceJobSubmitter#needHdfs. Below code can be simplified to just one

[jira] [Comment Edited] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681561#comment-16681561 ] Wanqiang Ji edited comment on YARN-8995 at 11/9/18 3:03 PM: +1 I am looking

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681561#comment-16681561 ] Wanqiang Ji commented on YARN-8995: --- +1 I'm looking forward to seeing this patch. > Log the event type

[jira] [Commented] (YARN-9214) Add AbstractYarnScheduler#getValidQueues method to resolve duplicate code

2019-01-21 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16747949#comment-16747949 ] Wanqiang Ji commented on YARN-9214: --- Hi, [~cheersyang] can you help to review? > Add

[jira] [Updated] (YARN-9214) Add AbstractYarnScheduler#getValidQueues method to resolve duplicate code

2019-01-20 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9214: -- Description: *AbstractYarnScheduler#moveAllApps* and *AbstractYarnScheduler#killAllAppsInQueue* had the

[jira] [Created] (YARN-9214) Add AbstractYarnScheduler#getValidQueues method to resolve duplicate code

2019-01-20 Thread Wanqiang Ji (JIRA)
Wanqiang Ji created YARN-9214: - Summary: Add AbstractYarnScheduler#getValidQueues method to resolve duplicate code Key: YARN-9214 URL: https://issues.apache.org/jira/browse/YARN-9214 Project: Hadoop

[jira] [Updated] (YARN-9214) Add AbstractYarnScheduler#getValidQueues method to resolve duplicate code

2019-01-20 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9214: -- Affects Version/s: 3.2.0 > Add AbstractYarnScheduler#getValidQueues method to resolve duplicate code >

[jira] [Commented] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-28 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701664#comment-16701664 ] Wanqiang Ji commented on YARN-9041: --- Not sure why Jenkins gives -1 even all UTs have passed, I have seen

[jira] [Comment Edited] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-28 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701664#comment-16701664 ] Wanqiang Ji edited comment on YARN-9041 at 11/28/18 10:30 AM: -- Not sure why

[jira] [Updated] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-29 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9041: -- Attachment: YARN-9041.006.patch > Optimize FSPreemptionThread#identifyContainersToPreempt method >

[jira] [Commented] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-28 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702681#comment-16702681 ] Wanqiang Ji commented on YARN-9041: --- Thanks for [~Steven Rand] review and help. > Optimize

[jira] [Updated] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-12-03 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9041: -- Attachment: YARN-9041.007.patch > Optimize FSPreemptionThread#identifyContainersToPreempt method >

[jira] [Commented] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-12-03 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708140#comment-16708140 ] Wanqiang Ji commented on YARN-9041: --- I'm so sorry for this brought unnecessary trouble to you,

[jira] [Commented] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-29 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704300#comment-16704300 ] Wanqiang Ji commented on YARN-9041: --- Hi [~yufeigu], the v6 patch fixed all the issues you mentioned. Pls

[jira] [Updated] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-20 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9041: -- Component/s: scheduler preemption > Optimize FSPreemptionThread#identifyContainersToPreempt method >

[jira] [Created] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-20 Thread Wanqiang Ji (JIRA)
Wanqiang Ji created YARN-9041: - Summary: Optimize FSPreemptionThread#identifyContainersToPreempt method Key: YARN-9041 URL: https://issues.apache.org/jira/browse/YARN-9041 Project: Hadoop YARN

[jira] [Commented] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-20 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694275#comment-16694275 ] Wanqiang Ji commented on YARN-9041: --- The UT failure should be irrelevant, I tested locally it can work

[jira] [Commented] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-21 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694366#comment-16694366 ] Wanqiang Ji commented on YARN-9041: --- Thanks for [~Steven Rand] detailed review. You are right, I ignored

[jira] [Commented] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-20 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694310#comment-16694310 ] Wanqiang Ji commented on YARN-9005: --- Hi [~yufeigu], sorry to miss your latest reply. I created the new

[jira] [Updated] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-21 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9041: -- Attachment: YARN-9041.002.patch > Optimize FSPreemptionThread#identifyContainersToPreempt method >

[jira] [Commented] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-27 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700592#comment-16700592 ] Wanqiang Ji commented on YARN-9041: --- Hi [~yufeigu], thanks for your detailed review. I added the UT in

[jira] [Comment Edited] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-27 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700424#comment-16700424 ] Wanqiang Ji edited comment on YARN-9041 at 11/27/18 3:39 PM: - Hi [~Steven

[jira] [Updated] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-27 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9041: -- Attachment: YARN-9041.003.patch > Optimize FSPreemptionThread#identifyContainersToPreempt method >

[jira] [Updated] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-27 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9041: -- Attachment: YARN-9041.004.patch > Optimize FSPreemptionThread#identifyContainersToPreempt method >

[jira] [Commented] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-27 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701374#comment-16701374 ] Wanqiang Ji commented on YARN-9041: --- Updated 004 patch to fix the checkstyle issue and change the new UT

[jira] [Updated] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-27 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9041: -- Attachment: YARN-9041.005.patch > Optimize FSPreemptionThread#identifyContainersToPreempt method >

[jira] [Commented] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-27 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700424#comment-16700424 ] Wanqiang Ji commented on YARN-9041: --- Hi [~Steven Rand], thanks for your detailed review. {quote}I'm

[jira] [Commented] (YARN-9214) Add AbstractYarnScheduler#getValidQueues method to resolve duplicate code

2019-03-29 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16805031#comment-16805031 ] Wanqiang Ji commented on YARN-9214: --- Thanks [~snemeth] review, I will submit a new patch only resolve

[jira] [Updated] (YARN-9214) Add AbstractYarnScheduler#getValidQueues method to resolve duplicate code

2019-03-29 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9214: -- Attachment: YARN-9214.003.patch > Add AbstractYarnScheduler#getValidQueues method to resolve duplicate

[jira] [Commented] (YARN-9214) Add AbstractYarnScheduler#getValidQueues method to resolve duplicate code

2019-03-31 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806360#comment-16806360 ] Wanqiang Ji commented on YARN-9214: --- Thank [~yufeigu] for reviewing this. I don't know the original

[jira] [Assigned] (YARN-9386) destroying yarn-service is allowed even though running state

2019-03-20 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji reassigned YARN-9386: - Assignee: kyungwan nam > destroying yarn-service is allowed even though running state >

[jira] [Commented] (YARN-9401) Fix `yarn version` print the version info is the same as `hadoop version`

2019-03-21 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797946#comment-16797946 ] Wanqiang Ji commented on YARN-9401: --- Hi, [~eyang] Can you help to review this? > Fix `yarn version`

[jira] [Updated] (YARN-9214) Add AbstractYarnScheduler#getValidQueues method to resolve duplicate code

2019-03-28 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9214: -- Attachment: YARN-9214.002.patch > Add AbstractYarnScheduler#getValidQueues method to resolve duplicate

[jira] [Issue Comment Deleted] (YARN-9401) Fix `yarn version` print the version info is the same as `hadoop version`

2019-03-27 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9401: -- Comment: was deleted (was: Hi, [~eyang]. Can you help to review this?) > Fix `yarn version` print the

[jira] [Commented] (YARN-9401) Fix `yarn version` print the version info is the same as `hadoop version`

2019-03-31 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806396#comment-16806396 ] Wanqiang Ji commented on YARN-9401: --- Hi [~cheersyang] {panel:title=Before} Hadoop 3.3.0-SNAPSHOT Source

[jira] [Updated] (YARN-9401) Fix `yarn version` print the version info is the same as `hadoop version`

2019-03-31 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9401: -- Description: It's caused by in `yarn` shell used `org.apache.hadoop.util.VersionInfo` instead of

[jira] [Updated] (YARN-9214) Add AbstractYarnScheduler#getValidQueues method to resolve duplicate code

2019-03-31 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9214: -- Attachment: YARN-9214.005.patch > Add AbstractYarnScheduler#getValidQueues method to resolve duplicate

[jira] [Updated] (YARN-9214) Add AbstractYarnScheduler#getValidQueues method to resolve duplicate code

2019-03-31 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9214: -- Attachment: YARN-9214.004.patch > Add AbstractYarnScheduler#getValidQueues method to resolve duplicate

[jira] [Comment Edited] (YARN-9401) Fix `yarn version` print the version info is the same as `hadoop version`

2019-04-01 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806396#comment-16806396 ] Wanqiang Ji edited comment on YARN-9401 at 4/1/19 2:23 PM: --- Hi [~cheersyang],  

[jira] [Comment Edited] (YARN-9214) Add AbstractYarnScheduler#getValidQueues method to resolve duplicate code

2019-02-26 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1628#comment-1628 ] Wanqiang Ji edited comment on YARN-9214 at 2/26/19 9:00 AM: Hi, [~cheersyang], 

[jira] [Commented] (YARN-9214) Add AbstractYarnScheduler#getValidQueues method to resolve duplicate code

2019-02-26 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1628#comment-1628 ] Wanqiang Ji commented on YARN-9214: --- Hi, [~cheersyang] [~eepayne] [~Prabhu Joseph] Due to different

[jira] [Comment Edited] (YARN-9214) Add AbstractYarnScheduler#getValidQueues method to resolve duplicate code

2019-03-01 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1628#comment-1628 ] Wanqiang Ji edited comment on YARN-9214 at 3/2/19 12:20 AM: Hi, [~cheersyang], 

[jira] [Issue Comment Deleted] (YARN-9214) Add AbstractYarnScheduler#getValidQueues method to resolve duplicate code

2019-02-26 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9214: -- Comment: was deleted (was: Hi, [~cheersyang] can you help to review?) > Add

[jira] [Created] (YARN-9401) Fix `yarn version` print the version info is the same as `hadoop version`

2019-03-20 Thread Wanqiang Ji (JIRA)
Wanqiang Ji created YARN-9401: - Summary: Fix `yarn version` print the version info is the same as `hadoop version` Key: YARN-9401 URL: https://issues.apache.org/jira/browse/YARN-9401 Project: Hadoop YARN

[jira] [Commented] (YARN-9401) Fix `yarn version` print the version info is the same as `hadoop version`

2019-03-20 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796979#comment-16796979 ] Wanqiang Ji commented on YARN-9401: --- I forgot to patch into the yarn.cmd in v1 patch, so submitted the

[jira] [Updated] (YARN-9401) Fix `yarn version` print the version info is the same as `hadoop version`

2019-03-20 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9401: -- Attachment: YARN-9401.002.patch > Fix `yarn version` print the version info is the same as `hadoop

[jira] [Comment Edited] (YARN-9401) Fix `yarn version` print the version info is the same as `hadoop version`

2019-03-21 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797946#comment-16797946 ] Wanqiang Ji edited comment on YARN-9401 at 3/22/19 1:56 AM: Hi, [~eyang]. Can

[jira] [Commented] (YARN-9453) Clean up code long if-else chain in ApplicationCLI#run

2019-04-07 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811794#comment-16811794 ] Wanqiang Ji commented on YARN-9453: --- Hi [~snemeth], I can work for this if you not mind. > Clean up

[jira] [Assigned] (YARN-9453) Clean up code long if-else chain in ApplicationCLI#run

2019-04-07 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji reassigned YARN-9453: - Assignee: Wanqiang Ji > Clean up code long if-else chain in ApplicationCLI#run >

[jira] [Commented] (YARN-9493) Fix Scheduler Page can't display the right page by query string

2019-04-17 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820670#comment-16820670 ] Wanqiang Ji commented on YARN-9493: --- Thanks [~giovanni.fumarola] for reviewing. I will fix the

[jira] [Updated] (YARN-9493) Fix Scheduler Page can't display the right page by query string

2019-04-17 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9493: -- Attachment: YARN-9493.002.patch > Fix Scheduler Page can't display the right page by query string >

[jira] [Created] (YARN-9493) Fix Scheduler Page can't display the right page by query string

2019-04-17 Thread Wanqiang Ji (JIRA)
Wanqiang Ji created YARN-9493: - Summary: Fix Scheduler Page can't display the right page by query string Key: YARN-9493 URL: https://issues.apache.org/jira/browse/YARN-9493 Project: Hadoop YARN

[jira] [Commented] (YARN-9453) Clean up code long if-else chain in ApplicationCLI#run

2019-04-14 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16817251#comment-16817251 ] Wanqiang Ji commented on YARN-9453: --- 003 patch fixed the checkstyle's issue. The UT failure is not

[jira] [Updated] (YARN-9453) Clean up code long if-else chain in ApplicationCLI#run

2019-04-14 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9453: -- Attachment: YARN-9453.002.patch > Clean up code long if-else chain in ApplicationCLI#run >

[jira] [Commented] (YARN-9453) Clean up code long if-else chain in ApplicationCLI#run

2019-04-14 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16817210#comment-16817210 ] Wanqiang Ji commented on YARN-9453: --- 002 patch fixed all the issues from Yetus. > Clean up code long

[jira] [Updated] (YARN-9453) Clean up code long if-else chain in ApplicationCLI#run

2019-04-14 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9453: -- Attachment: YARN-9453.003.patch > Clean up code long if-else chain in ApplicationCLI#run >

[jira] [Commented] (YARN-9584) Should put initializeProcessTrees method call before get pid

2019-05-27 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16849245#comment-16849245 ] Wanqiang Ji commented on YARN-9584: --- Thanks for [~tangzhankun] for reviewing this. If we want to add a

[jira] [Updated] (YARN-9584) Should put initializeProcessTrees method call before get pid

2019-05-27 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9584: -- Description: In ContainerMonitorImpl#MonitoringThread.run method had a logical error that get pid

[jira] [Commented] (YARN-9584) Should put initializeProcessTrees method call before get pid

2019-05-27 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16849356#comment-16849356 ] Wanqiang Ji commented on YARN-9584: --- Hi [~tangzhankun], sure it will cost much effort do that. But I can

[jira] [Created] (YARN-9584) Should put initializeProcessTrees method call before get pid

2019-05-27 Thread Wanqiang Ji (JIRA)
Wanqiang Ji created YARN-9584: - Summary: Should put initializeProcessTrees method call before get pid Key: YARN-9584 URL: https://issues.apache.org/jira/browse/YARN-9584 Project: Hadoop YARN

[jira] [Updated] (YARN-9584) Should put initializeProcessTrees method call before get pid

2019-05-27 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9584: -- Attachment: YARN-9584.001.patch > Should put initializeProcessTrees method call before get pid >

[jira] [Updated] (YARN-9584) Should put initializeProcessTrees method call before get pid

2019-05-27 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9584: -- Affects Version/s: 3.2.0 3.0.3 3.1.2 > Should put

[jira] [Commented] (YARN-9630) [UI2] Add a link in docs's top page

2019-06-17 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16865658#comment-16865658 ] Wanqiang Ji commented on YARN-9630: --- Thanks [~snemeth] for reviewing. > [UI2] Add a link in docs's top

[jira] [Commented] (YARN-9574) ArtifactId of MaWo application is wrong

2019-06-17 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866131#comment-16866131 ] Wanqiang Ji commented on YARN-9574: --- Thanks [~eyang], 002 patch fixed it. > ArtifactId of MaWo

[jira] [Commented] (YARN-9584) Should put initializeProcessTrees method call before get pid

2019-06-17 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866221#comment-16866221 ] Wanqiang Ji commented on YARN-9584: --- Thanks [~tangzhankun] > Should put initializeProcessTrees method

[jira] [Commented] (YARN-9630) [UI2] Add a link in docs's top page

2019-06-18 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866265#comment-16866265 ] Wanqiang Ji commented on YARN-9630: --- Thanks [~iwasakims] > [UI2] Add a link in docs's top page >

[jira] [Updated] (YARN-9574) ArtifactId of MaWo application is wrong

2019-06-17 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9574: -- Attachment: YARN-9574.002.patch > ArtifactId of MaWo application is wrong >

[jira] [Commented] (YARN-9635) Nodes page displayed duplicate nodes

2019-06-24 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16871993#comment-16871993 ] Wanqiang Ji commented on YARN-9635: --- Thanks [~Tao Yang], I will take some time to make sure whether

[jira] [Commented] (YARN-9635) Nodes page displayed duplicate nodes

2019-06-25 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872077#comment-16872077 ] Wanqiang Ji commented on YARN-9635: --- Hi, [~Tao Yang] and [~sunilg]. In my opinion, although user used

[jira] [Updated] (YARN-9635) Nodes page displayed duplicate nodes

2019-06-25 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9635: -- Component/s: (was: api) resourcemanager nodemanager > Nodes page

  1   2   >