[
https://issues.apache.org/jira/browse/YARN-9403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prabhu Joseph updated YARN-9403:
--------------------------------
Description:
"GET /apps/{appid}/entities/YARN_APPLICATION" accesses application table
instead of entity table. As per the doc, With this API, you can query generic
entities identified by cluster ID, application ID and per-framework entity
type. But it also provides all the apps when entityType is set to
YARN_APPLICATION. It should only access Entity Table through
{{GenericEntityReader}}.
Wrong Output: With YARN_APPLICATION entityType, all applications listed from
application tables.
{code}
[hbase@yarn-ats-3 centos]$ curl -s
"http://yarn-ats-3:8198/ws/v2/timeline/apps/application_1553258815132_0002/entities/YARN_APPLICATION?user.name=hbase&userid=hbase&flowname=word%20count";
| jq .
[
{
"metrics": [],
"events": [],
"createdtime": 1553258922721,
"idprefix": 0,
"isrelatedto": {},
"relatesto": {},
"info": {
"UID": "ats!application_1553258815132_0002",
"FROM_ID": "ats!hbase!word
count!1553258922721!application_1553258815132_0002"
},
"configs": {},
"type": "YARN_APPLICATION",
"id": "application_1553258815132_0002"
},
{
"metrics": [],
"events": [],
"createdtime": 1553258825918,
"idprefix": 0,
"isrelatedto": {},
"relatesto": {},
"info": {
"UID": "ats!application_1553258815132_0001",
"FROM_ID": "ats!hbase!word
count!1553258825918!application_1553258815132_0001"
},
"configs": {},
"type": "YARN_APPLICATION",
"id": "application_1553258815132_0001"
}
]
{code}
Right Output: With correct entity type (MAPREDUCE_JOB) it accesses entity table
for given applicationId and entityType.
{code}
[hbase@yarn-ats-3 centos]$ curl -s
"http://yarn-ats-3:8198/ws/v2/timeline/apps/application_1553258815132_0002/entities/MAPREDUCE_JOB?user.name=hbase&userid=hbase&flowname=word%20count";
| jq .
[
{
"metrics": [],
"events": [],
"createdtime": 1553258926667,
"idprefix": 0,
"isrelatedto": {},
"relatesto": {},
"info": {
"UID":
"ats!application_1553258815132_0002!MAPREDUCE_JOB!0!job_1553258815132_0002",
"FROM_ID": "ats!hbase!word
count!1553258922721!application_1553258815132_0002!MAPREDUCE_JOB!0!job_1553258815132_0002"
},
"configs": {},
"type": "MAPREDUCE_JOB",
"id": "job_1553258815132_0002"
}
]
{code}
was:
GET /apps/{appid}/entities/YARN_APPLICATION accesses application table instead
of entity table. As per the doc, With this API, you can query generic entities
identified by cluster ID, application ID and per-framework entity type. But it
also provides all the apps when entityType is set to YARN_APPLICATION. It
should only access Entity Table through {{GenericEntityReader}}.
Wrong Output: With YARN_APPLICATION entityType, all applications listed from
application tables.
{code}
[hbase@yarn-ats-3 centos]$ curl -s
"http://yarn-ats-3:8198/ws/v2/timeline/apps/application_1553258815132_0002/entities/YARN_APPLICATION?user.name=hbase&userid=hbase&flowname=word%20count";
| jq .
[
{
"metrics": [],
"events": [],
"createdtime": 1553258922721,
"idprefix": 0,
"isrelatedto": {},
"relatesto": {},
"info": {
"UID": "ats!application_1553258815132_0002",
"FROM_ID": "ats!hbase!word
count!1553258922721!application_1553258815132_0002"
},
"configs": {},
"type": "YARN_APPLICATION",
"id": "application_1553258815132_0002"
},
{
"metrics": [],
"events": [],
"createdtime": 1553258825918,
"idprefix": 0,
"isrelatedto": {},
"relatesto": {},
"info": {
"UID": "ats!application_1553258815132_0001",
"FROM_ID": "ats!hbase!word
count!1553258825918!application_1553258815132_0001"
},
"configs": {},
"type": "YARN_APPLICATION",
"id": "application_1553258815132_0001"
}
]
{code}
Right Output: With correct entity type (MAPREDUCE_JOB) it accesses entity table
for given applicationId and entityType.
{code}
[hbase@yarn-ats-3 centos]$ curl -s
"http://yarn-ats-3:8198/ws/v2/timeline/apps/application_1553258815132_0002/entities/MAPREDUCE_JOB?user.name=hbase&userid=hbase&flowname=word%20count";
| jq .
[
{
"metrics": [],
"events": [],
"createdtime": 1553258926667,
"idprefix": 0,
"isrelatedto": {},
"relatesto": {},
"info": {
"UID":
"ats!application_1553258815132_0002!MAPREDUCE_JOB!0!job_1553258815132_0002",
"FROM_ID": "ats!hbase!word
count!1553258922721!application_1553258815132_0002!MAPREDUCE_JOB!0!job_1553258815132_0002"
},
"configs": {},
"type": "MAPREDUCE_JOB",
"id": "job_1553258815132_0002"
}
]
{code}
> GET /apps/{appid}/entities/YARN_APPLICATION accesses application table
> instead of entity table
> ----------------------------------------------------------------------------------------------
>
> Key: YARN-9403
> URL: https://issues.apache.org/jira/browse/YARN-9403
> Project: Hadoop YARN
> Issue Type: Bug
> Components: ATSv2
> Affects Versions: 3.2.0
> Reporter: Prabhu Joseph
> Assignee: Prabhu Joseph
> Priority: Major
>
> "GET /apps/{appid}/entities/YARN_APPLICATION" accesses application table
> instead of entity table. As per the doc, With this API, you can query generic
> entities identified by cluster ID, application ID and per-framework entity
> type. But it also provides all the apps when entityType is set to
> YARN_APPLICATION. It should only access Entity Table through
> {{GenericEntityReader}}.
> Wrong Output: With YARN_APPLICATION entityType, all applications listed from
> application tables.
> {code}
> [hbase@yarn-ats-3 centos]$ curl -s
> "http://yarn-ats-3:8198/ws/v2/timeline/apps/application_1553258815132_0002/entities/YARN_APPLICATION?user.name=hbase&userid=hbase&flowname=word%20count";
> | jq .
> [
> {
> "metrics": [],
> "events": [],
> "createdtime": 1553258922721,
> "idprefix": 0,
> "isrelatedto": {},
> "relatesto": {},
> "info": {
> "UID": "ats!application_1553258815132_0002",
> "FROM_ID": "ats!hbase!word
> count!1553258922721!application_1553258815132_0002"
> },
> "configs": {},
> "type": "YARN_APPLICATION",
> "id": "application_1553258815132_0002"
> },
> {
> "metrics": [],
> "events": [],
> "createdtime": 1553258825918,
> "idprefix": 0,
> "isrelatedto": {},
> "relatesto": {},
> "info": {
> "UID": "ats!application_1553258815132_0001",
> "FROM_ID": "ats!hbase!word
> count!1553258825918!application_1553258815132_0001"
> },
> "configs": {},
> "type": "YARN_APPLICATION",
> "id": "application_1553258815132_0001"
> }
> ]
> {code}
> Right Output: With correct entity type (MAPREDUCE_JOB) it accesses entity
> table for given applicationId and entityType.
> {code}
> [hbase@yarn-ats-3 centos]$ curl -s
> "http://yarn-ats-3:8198/ws/v2/timeline/apps/application_1553258815132_0002/entities/MAPREDUCE_JOB?user.name=hbase&userid=hbase&flowname=word%20count";
> | jq .
> [
> {
> "metrics": [],
> "events": [],
> "createdtime": 1553258926667,
> "idprefix": 0,
> "isrelatedto": {},
> "relatesto": {},
> "info": {
> "UID":
> "ats!application_1553258815132_0002!MAPREDUCE_JOB!0!job_1553258815132_0002",
> "FROM_ID": "ats!hbase!word
> count!1553258922721!application_1553258815132_0002!MAPREDUCE_JOB!0!job_1553258815132_0002"
> },
> "configs": {},
> "type": "MAPREDUCE_JOB",
> "id": "job_1553258815132_0002"
> }
> ]
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
