[
https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737122#comment-14737122
]
Sreenath Somarajapuram edited comment on TEZ-2792 at 9/9/15 4:22 PM:
---------------------------------------------------------------------
[~hitesh]
- '*'
-- Sorry that I missed that change by the IDE, will revert the same in patch 2.
- minID:
-- They are minimized version of complete entity ID.
-- Helps to shorten the url length.
-- dagMinID = dagIndex
-- vertexMinID = vertexIndex
-- taskMinID = vertexIndex_taskIndex
-- attemptMinID = vertexIndex_taskIndex_attemptNo (vertexIndex_taskIndex =
vertexIndex_taskIndex_0 making it shorter in most cases)
- Why dagMinID:
-- The complete url looks like
http://address:8088/proxy/application_1441301219877_0111/ws/v2/tez/tasksInfo?dagMinID=1&taskMinID=0_48,0_49,0_46,0_47,0_44,0_45,0_43,0_42,0_41,0_40,0_39,0_38,0_36,0_37,0_35,0_34,0_33,0_32,0_31,0_30,0_28,0_29,0_27,0_26,0_24
-- dagMinID was added considering applications that might have multiple DAGs.
-- Also RM uses the complete application id to proxy to AM. Once there the full
dagID is not required.
- For getIntegersFromRequest() and getMinIDsFromRequest(), how do you
distinguish a request which says give me everything to one which had invalid
paramters passed in?
-- invalid paramters: Both the function will return null.
-- give me everything: Bith the function will give an empty array.
- It seems checkAndGetDAGFromRequestMinID() and checkAndGetDAGFromRequest are
similar except for the param name? Maybe the 2 can be combined?
-- Idea is to replace dagID with dagMinID. The function also will be removed.
-- A ticket have been created for the same TEZ-2793
- Making MAX_QUERIED configurable.
-- MAX_QUERIED is the default value, the UI can pass a higher limit.
-- Have created TEZ-2794 for the same.
was (Author: sreenath):
[~hitesh]
- '*'
-- Sorry that I missed that change by the IDE, will revert the same in patch 2.
- minID:
-- They are minimized version of complete entity ID.
-- Helps to shorten the url length.
-- dagMinID = dagIndex
-- vertexMinID = vertexIndex
-- taskMinID = vertexIndex_taskIndex
-- attemptMinID = vertexIndex_taskIndex_attemptNo (vertexIndex_taskIndex =
vertexIndex_taskIndex_0 making it shorter in most cases)
- Why dagMinID:
-- The complete url looks like
http://address:8088/proxy/application_1441301219877_0111/ws/v2/tez/tasksInfo?dagMinID=1&taskMinID=0_48,0_49,0_46,0_47,0_44,0_45,0_43,0_42,0_41,0_40,0_39,0_38,0_36,0_37,0_35,0_34,0_33,0_32,0_31,0_30,0_28,0_29,0_27,0_26,0_24
-- dagMinID was added considering applications that might have multiple DAGs.
-- Also RM uses the complete application id to proxy to AM. Once there the full
dagID is not required.
- For getIntegersFromRequest() and getMinIDsFromRequest(), how do you
distinguish a request which says give me everything to one which had invalid
paramters passed in?
-- invalid paramters: Both the function will return null.
-- give me everything: Bith the function will give an empty array.
- It seems checkAndGetDAGFromRequestMinID() and checkAndGetDAGFromRequest are
similar except for the param name? Maybe the 2 can be combined?
-- Idea is to replace dagID with dagMinID. The function also will be removed.
-- A ticket have been created for the same TEZ-2793
- Making MAX_QUERIED configurable.
-- Will change the count to 500 in patch 2.
-- Have created TEZ-2794 for the same.
> Add AM web service API for tasks.
> ---------------------------------
>
> Key: TEZ-2792
> URL: https://issues.apache.org/jira/browse/TEZ-2792
> Project: Apache Tez
> Issue Type: Sub-task
> Components: UI
> Reporter: Sreenath Somarajapuram
> Assignee: Sreenath Somarajapuram
> Attachments: TEZ-2792.1.patch
>
>
> Add AM API for fetching realtime tasks info:
> - API endpoint : /ws/v2/tez/tasksInfo
> - Query Params:
> -- dagMinID: dagMinID = dagIndex, (mandatory).
> -- vertexMinID: A comma separated list. vertexMinID = vertexIndex.
> -- taskMinID: A comma separated list. taskMinID = vertexIndex_taskIndex
> -- limit: Maximum number of items to be returned (Defaults to 100).
> - If taskMinID is passed: All (capped by limit) the specified tasks will be
> returned. vertexMinID if present wont be considered.
> - IF vertexMinID is passed: All (capped by limit) tasks under the vertices
> will be returned.
> - If just dagID is passed: All (capped by limit) tasks under the DAG will be
> returned.
> - Data returned: complete task id, progress, status
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
