[jira] [Updated] (TEZ-2792) Add AM web service API for tasks.
[ https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-2792: Fix Version/s: 0.8.1 0.7.1 > Add AM web service API for tasks. > - > > Key: TEZ-2792 > URL: https://issues.apache.org/jira/browse/TEZ-2792 > Project: Apache Tez > Issue Type: Sub-task > Components: UI >Reporter: Sreenath Somarajapuram >Assignee: Sreenath Somarajapuram > Fix For: 0.7.1, 0.8.1 > > Attachments: TEZ-2792.1.patch, TEZ-2792.2.patch, TEZ-2792.3.patch, > TEZ-2792.4.patch > > > Add AM API for fetching realtime tasks info: > - API endpoint : /ws/v2/tez/tasksInfo > - Query Params: > -- dagID: Just need to pass the dagIndex, (mandatory). > -- vertexID: Just need to pass the vertexIndex. Can be a comma separated list > -- taskID: Must be of the format _. For instance task > with index 5 in vertex 3 can be referenced using the id 3_5. Can be a comma > separated list. > -- limit: Maximum number of items to be returned (Defaults to 100). > - If taskID is passed: All (capped by limit) the specified tasks will be > returned. vertexID if present wont be considered. > - IF vertexID is passed: All (capped by limit) tasks under the vertices will > be returned. > - If just dagID is passed: All (capped by limit) tasks under the DAG will be > returned. > - Data returned: complete task id, progress, status -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (TEZ-2792) Add AM web service API for tasks.
[ https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-2792: Attachment: TEZ-2792.3.patch Attaching a patch with suggestions from [~hitesh] and a bug fix. Suggestions: 1. Added API & function comments 2. Graceful management of invalid vertex & task ids. Data of valid ids would be send back. Bug: getIntegersFromRequest & getIDsFromRequest was coded assuming string split function would return ["1", "2", "3"] for "1,2,3,4" and limit 3. But it was returning ["1", "2", "3,4"]. So requests with more than 100 task ids in the URL were failing. [~hitesh] [~pramachandran] Please review. > Add AM web service API for tasks. > - > > Key: TEZ-2792 > URL: https://issues.apache.org/jira/browse/TEZ-2792 > Project: Apache Tez > Issue Type: Sub-task > Components: UI >Reporter: Sreenath Somarajapuram >Assignee: Sreenath Somarajapuram > Attachments: TEZ-2792.1.patch, TEZ-2792.2.patch, TEZ-2792.3.patch > > > Add AM API for fetching realtime tasks info: > - API endpoint : /ws/v2/tez/tasksInfo > - Query Params: > -- dagID: Just need to pass the dagIndex, (mandatory). > -- vertexID: Just need to pass the vertexIndex. Can be a comma separated list > -- taskID: Must be of the format _. For instance task > with index 5 in vertex 3 can be referenced using the id 3_5. Can be a comma > separated list. > -- limit: Maximum number of items to be returned (Defaults to 100). > - If taskID is passed: All (capped by limit) the specified tasks will be > returned. vertexID if present wont be considered. > - IF vertexID is passed: All (capped by limit) tasks under the vertices will > be returned. > - If just dagID is passed: All (capped by limit) tasks under the DAG will be > returned. > - Data returned: complete task id, progress, status -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (TEZ-2792) Add AM web service API for tasks.
[ https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-2792: Attachment: (was: TEZ-2792.4.patch) > Add AM web service API for tasks. > - > > Key: TEZ-2792 > URL: https://issues.apache.org/jira/browse/TEZ-2792 > Project: Apache Tez > Issue Type: Sub-task > Components: UI >Reporter: Sreenath Somarajapuram >Assignee: Sreenath Somarajapuram > Attachments: TEZ-2792.1.patch, TEZ-2792.2.patch, TEZ-2792.3.patch > > > Add AM API for fetching realtime tasks info: > - API endpoint : /ws/v2/tez/tasksInfo > - Query Params: > -- dagID: Just need to pass the dagIndex, (mandatory). > -- vertexID: Just need to pass the vertexIndex. Can be a comma separated list > -- taskID: Must be of the format _. For instance task > with index 5 in vertex 3 can be referenced using the id 3_5. Can be a comma > separated list. > -- limit: Maximum number of items to be returned (Defaults to 100). > - If taskID is passed: All (capped by limit) the specified tasks will be > returned. vertexID if present wont be considered. > - IF vertexID is passed: All (capped by limit) tasks under the vertices will > be returned. > - If just dagID is passed: All (capped by limit) tasks under the DAG will be > returned. > - Data returned: complete task id, progress, status -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (TEZ-2792) Add AM web service API for tasks.
[ https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-2792: Attachment: TEZ-2792.4.patch > Add AM web service API for tasks. > - > > Key: TEZ-2792 > URL: https://issues.apache.org/jira/browse/TEZ-2792 > Project: Apache Tez > Issue Type: Sub-task > Components: UI >Reporter: Sreenath Somarajapuram >Assignee: Sreenath Somarajapuram > Attachments: TEZ-2792.1.patch, TEZ-2792.2.patch, TEZ-2792.3.patch, > TEZ-2792.4.patch > > > Add AM API for fetching realtime tasks info: > - API endpoint : /ws/v2/tez/tasksInfo > - Query Params: > -- dagID: Just need to pass the dagIndex, (mandatory). > -- vertexID: Just need to pass the vertexIndex. Can be a comma separated list > -- taskID: Must be of the format _. For instance task > with index 5 in vertex 3 can be referenced using the id 3_5. Can be a comma > separated list. > -- limit: Maximum number of items to be returned (Defaults to 100). > - If taskID is passed: All (capped by limit) the specified tasks will be > returned. vertexID if present wont be considered. > - IF vertexID is passed: All (capped by limit) tasks under the vertices will > be returned. > - If just dagID is passed: All (capped by limit) tasks under the DAG will be > returned. > - Data returned: complete task id, progress, status -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (TEZ-2792) Add AM web service API for tasks.
[ https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-2792: Attachment: TEZ-2792.2.patch Thanks [~hitesh] Please find the patch with the comments addressed. - '*' changed - As MinID was confusing, all were changed to just ID - checkAndGetDAGFromRequestMinID was removed - Using "!isEmpty()" instead of "size() == 0" For bigger changes, respective tickets have been created. > Add AM web service API for tasks. > - > > Key: TEZ-2792 > URL: https://issues.apache.org/jira/browse/TEZ-2792 > Project: Apache Tez > Issue Type: Sub-task > Components: UI >Reporter: Sreenath Somarajapuram >Assignee: Sreenath Somarajapuram > Attachments: TEZ-2792.1.patch, TEZ-2792.2.patch > > > Add AM API for fetching realtime tasks info: > - API endpoint : /ws/v2/tez/tasksInfo > - Query Params: > -- dagMinID: dagMinID = dagIndex, (mandatory). > -- vertexMinID: A comma separated list. vertexMinID = vertexIndex. > -- taskMinID: A comma separated list. taskMinID = vertexIndex_taskIndex > -- limit: Maximum number of items to be returned (Defaults to 100). > - If taskMinID is passed: All (capped by limit) the specified tasks will be > returned. vertexMinID if present wont be considered. > - IF vertexMinID is passed: All (capped by limit) tasks under the vertices > will be returned. > - If just dagID is passed: All (capped by limit) tasks under the DAG will be > returned. > - Data returned: complete task id, progress, status -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (TEZ-2792) Add AM web service API for tasks.
[ https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-2792: Description: Add AM API for fetching realtime tasks info: - API endpoint : /ws/v2/tez/tasksInfo - Query Params: -- dagMinID: dagID = dagIndex, (mandatory). -- vertexMinID: A comma separated list. vertexID = vertexIndex. -- taskMinID: A comma separated list. taskID = vertexIndex_taskIndex -- limit: Maximum number of items to be returned (Defaults to 100). - If taskMinID is passed: All (capped by limit) the specified tasks will be returned. vertexMinID if present wont be considered. - IF vertexMinID is passed: All (capped by limit) tasks under the vertices will be returned. - If just dagID is passed: All (capped by limit) tasks under the DAG will be returned. - Data returned: complete task id, progress, status was: Add AM API for fetching realtime tasks info: - API endpoint : /ws/v2/tez/tasksInfo - Query Params: -- dagMinID: dagMinID = dagIndex, (mandatory). -- vertexMinID: A comma separated list. vertexMinID = vertexIndex. -- taskMinID: A comma separated list. taskMinID = vertexIndex_taskIndex -- limit: Maximum number of items to be returned (Defaults to 100). - If taskMinID is passed: All (capped by limit) the specified tasks will be returned. vertexMinID if present wont be considered. - IF vertexMinID is passed: All (capped by limit) tasks under the vertices will be returned. - If just dagID is passed: All (capped by limit) tasks under the DAG will be returned. - Data returned: complete task id, progress, status > Add AM web service API for tasks. > - > > Key: TEZ-2792 > URL: https://issues.apache.org/jira/browse/TEZ-2792 > Project: Apache Tez > Issue Type: Sub-task > Components: UI >Reporter: Sreenath Somarajapuram >Assignee: Sreenath Somarajapuram > Attachments: TEZ-2792.1.patch, TEZ-2792.2.patch > > > Add AM API for fetching realtime tasks info: > - API endpoint : /ws/v2/tez/tasksInfo > - Query Params: > -- dagMinID: dagID = dagIndex, (mandatory). > -- vertexMinID: A comma separated list. vertexID = vertexIndex. > -- taskMinID: A comma separated list. taskID = vertexIndex_taskIndex > -- limit: Maximum number of items to be returned (Defaults to 100). > - If taskMinID is passed: All (capped by limit) the specified tasks will be > returned. vertexMinID if present wont be considered. > - IF vertexMinID is passed: All (capped by limit) tasks under the vertices > will be returned. > - If just dagID is passed: All (capped by limit) tasks under the DAG will be > returned. > - Data returned: complete task id, progress, status -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (TEZ-2792) Add AM web service API for tasks.
[ https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-2792: Description: Add AM API for fetching realtime tasks info: - API endpoint : /ws/v2/tez/tasksInfo - Query Params: -- dagID: Just need to pass the dagIndex, (mandatory). -- vertexID: Just need to pass the vertexIndex. Can be a comma separated list -- taskID: Must be of the format _. For instance task with index 5 in vertex 3 can be referenced using the id 3_5. Can be a comma separated list. -- limit: Maximum number of items to be returned (Defaults to 100). - If taskID is passed: All (capped by limit) the specified tasks will be returned. vertexID if present wont be considered. - IF vertexID is passed: All (capped by limit) tasks under the vertices will be returned. - If just dagID is passed: All (capped by limit) tasks under the DAG will be returned. - Data returned: complete task id, progress, status was: Add AM API for fetching realtime tasks info: - API endpoint : /ws/v2/tez/tasksInfo - Query Params: -- dagMinID: dagID = dagIndex, (mandatory). -- vertexMinID: A comma separated list. vertexID = vertexIndex. -- taskMinID: A comma separated list. taskID = vertexIndex_taskIndex -- limit: Maximum number of items to be returned (Defaults to 100). - If taskMinID is passed: All (capped by limit) the specified tasks will be returned. vertexMinID if present wont be considered. - IF vertexMinID is passed: All (capped by limit) tasks under the vertices will be returned. - If just dagID is passed: All (capped by limit) tasks under the DAG will be returned. - Data returned: complete task id, progress, status > Add AM web service API for tasks. > - > > Key: TEZ-2792 > URL: https://issues.apache.org/jira/browse/TEZ-2792 > Project: Apache Tez > Issue Type: Sub-task > Components: UI >Reporter: Sreenath Somarajapuram >Assignee: Sreenath Somarajapuram > Attachments: TEZ-2792.1.patch, TEZ-2792.2.patch > > > Add AM API for fetching realtime tasks info: > - API endpoint : /ws/v2/tez/tasksInfo > - Query Params: > -- dagID: Just need to pass the dagIndex, (mandatory). > -- vertexID: Just need to pass the vertexIndex. Can be a comma separated list > -- taskID: Must be of the format _. For instance task > with index 5 in vertex 3 can be referenced using the id 3_5. Can be a comma > separated list. > -- limit: Maximum number of items to be returned (Defaults to 100). > - If taskID is passed: All (capped by limit) the specified tasks will be > returned. vertexID if present wont be considered. > - IF vertexID is passed: All (capped by limit) tasks under the vertices will > be returned. > - If just dagID is passed: All (capped by limit) tasks under the DAG will be > returned. > - Data returned: complete task id, progress, status -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (TEZ-2792) Add AM web service API for tasks.
[ https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-2792: Description: Add AM API for fetching realtime tasks info: - API endpoint : /ws/v2/tez/tasksInfo - Query Params: -- dagID: The complete dagID, (mandatory). -- vertexMinID: A comma separated list. vertexMinID = vertexIndex. -- taskMinID: A comma separated list. taskMinID = vertexIndex_taskIndex -- limit: Maximum number of items to be returned (Defaults to 100). - If taskMinID is passed: All (capped by limit) the specified tasks will be returned. vertexMinID if present wont be considered. - IF vertexMinID is passed: All (capped by limit) tasks under the vertices will be returned. - If just dagID is passed: All (capped by limit) tasks under the DAG will be returned. - Data returned: complete task id, progress, status > Add AM web service API for tasks. > - > > Key: TEZ-2792 > URL: https://issues.apache.org/jira/browse/TEZ-2792 > Project: Apache Tez > Issue Type: Sub-task > Components: UI >Reporter: Sreenath Somarajapuram > > Add AM API for fetching realtime tasks info: > - API endpoint : /ws/v2/tez/tasksInfo > - Query Params: > -- dagID: The complete dagID, (mandatory). > -- vertexMinID: A comma separated list. vertexMinID = vertexIndex. > -- taskMinID: A comma separated list. taskMinID = vertexIndex_taskIndex > -- limit: Maximum number of items to be returned (Defaults to 100). > - If taskMinID is passed: All (capped by limit) the specified tasks will be > returned. vertexMinID if present wont be considered. > - IF vertexMinID is passed: All (capped by limit) tasks under the vertices > will be returned. > - If just dagID is passed: All (capped by limit) tasks under the DAG will be > returned. > - Data returned: complete task id, progress, status -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (TEZ-2792) Add AM web service API for tasks.
[ https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-2792: Description: Add AM API for fetching realtime tasks info: - API endpoint : /ws/v2/tez/tasksInfo - Query Params: -- dagMinID: dagMinID = dagIndex, (mandatory). -- vertexMinID: A comma separated list. vertexMinID = vertexIndex. -- taskMinID: A comma separated list. taskMinID = vertexIndex_taskIndex -- limit: Maximum number of items to be returned (Defaults to 100). - If taskMinID is passed: All (capped by limit) the specified tasks will be returned. vertexMinID if present wont be considered. - IF vertexMinID is passed: All (capped by limit) tasks under the vertices will be returned. - If just dagID is passed: All (capped by limit) tasks under the DAG will be returned. - Data returned: complete task id, progress, status was: Add AM API for fetching realtime tasks info: - API endpoint : /ws/v2/tez/tasksInfo - Query Params: -- dagID: The complete dagID, (mandatory). -- vertexMinID: A comma separated list. vertexMinID = vertexIndex. -- taskMinID: A comma separated list. taskMinID = vertexIndex_taskIndex -- limit: Maximum number of items to be returned (Defaults to 100). - If taskMinID is passed: All (capped by limit) the specified tasks will be returned. vertexMinID if present wont be considered. - IF vertexMinID is passed: All (capped by limit) tasks under the vertices will be returned. - If just dagID is passed: All (capped by limit) tasks under the DAG will be returned. - Data returned: complete task id, progress, status > Add AM web service API for tasks. > - > > Key: TEZ-2792 > URL: https://issues.apache.org/jira/browse/TEZ-2792 > Project: Apache Tez > Issue Type: Sub-task > Components: UI >Reporter: Sreenath Somarajapuram >Assignee: Sreenath Somarajapuram > > Add AM API for fetching realtime tasks info: > - API endpoint : /ws/v2/tez/tasksInfo > - Query Params: > -- dagMinID: dagMinID = dagIndex, (mandatory). > -- vertexMinID: A comma separated list. vertexMinID = vertexIndex. > -- taskMinID: A comma separated list. taskMinID = vertexIndex_taskIndex > -- limit: Maximum number of items to be returned (Defaults to 100). > - If taskMinID is passed: All (capped by limit) the specified tasks will be > returned. vertexMinID if present wont be considered. > - IF vertexMinID is passed: All (capped by limit) tasks under the vertices > will be returned. > - If just dagID is passed: All (capped by limit) tasks under the DAG will be > returned. > - Data returned: complete task id, progress, status -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (TEZ-2792) Add AM web service API for tasks.
[ https://issues.apache.org/jira/browse/TEZ-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-2792: Attachment: TEZ-2792.1.patch [~pramachandran] [~hitesh] Please review. > Add AM web service API for tasks. > - > > Key: TEZ-2792 > URL: https://issues.apache.org/jira/browse/TEZ-2792 > Project: Apache Tez > Issue Type: Sub-task > Components: UI >Reporter: Sreenath Somarajapuram >Assignee: Sreenath Somarajapuram > Attachments: TEZ-2792.1.patch > > > Add AM API for fetching realtime tasks info: > - API endpoint : /ws/v2/tez/tasksInfo > - Query Params: > -- dagMinID: dagMinID = dagIndex, (mandatory). > -- vertexMinID: A comma separated list. vertexMinID = vertexIndex. > -- taskMinID: A comma separated list. taskMinID = vertexIndex_taskIndex > -- limit: Maximum number of items to be returned (Defaults to 100). > - If taskMinID is passed: All (capped by limit) the specified tasks will be > returned. vertexMinID if present wont be considered. > - IF vertexMinID is passed: All (capped by limit) tasks under the vertices > will be returned. > - If just dagID is passed: All (capped by limit) tasks under the DAG will be > returned. > - Data returned: complete task id, progress, status -- This message was sent by Atlassian JIRA (v6.3.4#6332)
