[ 
https://issues.apache.org/jira/browse/YARN-8659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638932#comment-16638932
 ] 

Haibo Chen commented on YARN-8659:
----------------------------------

Thanks [~snemeth] for the analysis. I agree with your observation. 

When a queue is specified, the matching applications are retrieved currently 
from the scheduler, which knows only about the ones that are still actively 
involved in scheduling decision, a subset of all the applications that RM knows 
about.  An application is removed from the scheduler's knowledge as soon as its 
scheduling part is done, but RM can still retain the application in its memory 
until it is evicted  based on the max # of applications RM is allowed to 
remember.

IMO this is more of a bug than a API-compatibility-breaking change.  

To reproduce the bug and verify the behavioral change, I think we need two uni 
test methods,

1) Two applications, one running and the other finished, query with 
state=finished and a queue, the result should contain the finished app (the 
result is empty now)

2) Two applications, one running and the other finished, query with queue 
specified but no state, the result should include both applications (the result 
is empty now)

 

> RMWebServices returns only RUNNING apps when filtered with queue
> ----------------------------------------------------------------
>
>                 Key: YARN-8659
>                 URL: https://issues.apache.org/jira/browse/YARN-8659
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: yarn
>    Affects Versions: 2.7.3
>            Reporter: Prabhu Joseph
>            Assignee: Szilard Nemeth
>            Priority: Major
>         Attachments: Screen Shot 2018-08-13 at 8.01.29 PM.png, Screen Shot 
> 2018-08-13 at 8.01.52 PM.png, YARN-8659.001.patch
>
>
> RMWebServices returns only RUNNING apps when filtered with queue and returns 
> empty apps
> when filtered with both FINISHED states and queue.
> http://pjoseph-script-llap3.openstacklocal:8088/ws/v1/cluster/apps?queue=default
> http://pjoseph-script-llap3.openstacklocal:8088/ws/v1/cluster/apps?states=FINISHED&queue=default



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to