[ 
https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14182205#comment-14182205
 ] 

Carlo Curino commented on YARN-2664:
------------------------------------

Matteo, first of all, thanks for looking into this.

The "delta-encoding" you propose makes lots of sense and it is well aligned 
with the internal representation of resource allocations (which are mostly 
based on: *RLESparseResourceAllocation*), so you should be able to extract it 
from there easily. 

One thing we need to figure out is whether to use the javascript library I had 
in the "seed" patch above or other javascript (or non-javascript) visualization 
lib. Anything that can consume the json format you propose, and has an 
"amenable" licensing for hadoop is ok with me. (if anyone else has suggestions 
on this please chime in!) 

Another important problem will be "what" to visualize. I suspect that showing 
all jobs accepted over an arbitrary past/future time range is likely going to 
be too much for any large cluster... Being able to focus on a portion of the 
plan (e.g., time-range, user, queue) I think is going to be important. This 
would allow the GUI to lazily fetch the data corresponding to the portion of 
the plan we are visualizing, instead of dumping out the entire plan (which even 
with your much better delta-encoding might eventually be too big).

My 2 cents.. 


> Improve RM webapp to expose info about reservations.
> ----------------------------------------------------
>
>                 Key: YARN-2664
>                 URL: https://issues.apache.org/jira/browse/YARN-2664
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: resourcemanager
>            Reporter: Carlo Curino
>         Attachments: PlannerPage_screenshot.pdf, YARN-2664.patch
>
>
> YARN-1051 provides a new functionality in the RM to ask for reservation on 
> resources. Exposing this through the webapp GUI is important.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to