[jira] [Updated] (YARN-8023) REST API doesn't show new application
[
https://issues.apache.org/jira/browse/YARN-8023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Airton Sampaio de Sobral updated YARN-8023:
---
Description:
After killing an application using the HADOOP UI, and creating a new one with
the same configuration, the brand new one doesn't appear on the API route:
/api/v1/applications?status=running
I've tried the applications path as well (/api/v1/applications) without success.
This happens randomly and it seems that after a really long time, the new
instance appears on the API.
On the UI the new application instance appears, and it's working fine. (Print
screen on attachment).
On the API it shows the last instance of the application as it's running, but
it's dead by one hour!
{code:java}
/api/v1/applications?status=running
{
"id" : "application_1511385973584_0087",
"name" : "AdActionPaymentKafkaToJDBC",
"attempts" : [ {
"attemptId" : "1",
"startTime" : "2018-01-16T19:08:32.275GMT",
"endTime" : "1969-12-31T23:59:59.999GMT",
"lastUpdated" : "2018-01-16T19:08:34.016GMT",
"duration" : 0,
"sparkUser" : "hadoop",
"completed" : false,
"endTimeEpoch" : -1,
"startTimeEpoch" : 1516129712275,
"lastUpdatedEpoch" : 1516129714016
} ]
}
{code}
Update:
After two hours, the application appeared on the API response:
{code:java}
{
"id" : "application_1511385973584_0154",
"name" : "AdActionPaymentKafkaToJDBC",
"attempts" : [ {
"attemptId" : "1",
"startTime" : "2018-03-10T21:08:30.557GMT",
"endTime" : "1969-12-31T23:59:59.999GMT",
"lastUpdated" : "2018-03-10T21:08:32.310GMT",
"duration" : 0,
"sparkUser" : "hadoop",
"completed" : false,
"endTimeEpoch" : -1,
"startTimeEpoch" : 1520716110557,
"lastUpdatedEpoch" : 1520716112310
}
{code}
was:
After killing an application using the HADOOP UI, and creating a new one with
the same configuration, the brand new one doesn't appear on the API route:
/api/v1/applications?status=running
I've tried the applications path as well (/api/v1/applications) without success.
This happens randomly and it seems that after a really long time, the new
instance appears on the API.
On the UI the new application instance appears, and it's working fine. (Print
screen on attachment).
On the API it shows the last instance of the application as it's running, but
it's dead by one hour!
{code:java}
/api/v1/applications?status=running
{
"id" : "application_1511385973584_0087",
"name" : "AdActionPaymentKafkaToJDBC",
"attempts" : [ {
"attemptId" : "1",
"startTime" : "2018-01-16T19:08:32.275GMT",
"endTime" : "1969-12-31T23:59:59.999GMT",
"lastUpdated" : "2018-01-16T19:08:34.016GMT",
"duration" : 0,
"sparkUser" : "hadoop",
"completed" : false,
"endTimeEpoch" : -1,
"startTimeEpoch" : 1516129712275,
"lastUpdatedEpoch" : 1516129714016
} ]
}
{code}
> REST API doesn't show new application
> -
>
> Key: YARN-8023
> URL: https://issues.apache.org/jira/browse/YARN-8023
> Project: Hadoop YARN
> Issue Type: Bug
> Components: api
>Affects Versions: 2.7.3
> Environment: Release label:emr-5.5.0
> Hadoop distribution:Amazon 2.7.3
> Applications:Spark 2.1.0, Hive 2.1.1, Hue 3.12.0
>Reporter: Airton Sampaio de Sobral
>Priority: Major
> Attachments: Screen Shot 2018-03-10 at 5.46.13 PM.png
>
>
> After killing an application using the HADOOP UI, and creating a new one with
> the same configuration, the brand new one doesn't appear on the API route:
> /api/v1/applications?status=running
> I've tried the applications path as well (/api/v1/applications) without
> success.
> This happens randomly and it seems that after a really long time, the new
> instance appears on the API.
> On the UI the new application instance appears, and it's working fine. (Print
> screen on attachment).
> On the API it shows the last instance of the application as it's running, but
> it's dead by one hour!
> {code:java}
> /api/v1/applications?status=running
> {
> "id" : "application_1511385973584_0087",
> "name" : "AdActionPaymentKafkaToJDBC",
> "attempts" : [ {
> "attemptId" : "1",
> "startTime" : "2018-01-16T19:08:32.275GMT",
> "endTime" : "1969-12-31T23:59:59.999GMT",
> "lastUpdated" : "2018-01-16T19:08:34.016GMT",
> "duration" : 0,
> "sparkUser" : "hadoop",
> "completed" : false,
> "endTimeEpoch" : -1,
> "startTimeEpoch" : 1516129712275,
> "lastUpdatedEpoch" : 1516129714016
> } ]
> }
> {code}
>
> Update:
> After two hours, the application appeared on the API response:
>
> {code:java}
> {
> "id" : "application_1511385973584_0154",
> "name" : "AdActionPaymentKafkaToJDBC",
> "attempts" : [ {
> "attemptId" : "1",
> "startTime" : "2018-03-10T21:08:30.557GMT",
> "endTime" : "1969-12-31T23:59:59.999GMT",
> "lastUpdated" : "2018-03-10T21:08:32.310GMT",
> "duration" : 0,
> "sparkUser" : "hadoop",
> "completed" : false,
> "endTimeEpoch" : -1,
> "startTimeEpoch" :
[jira] [Updated] (YARN-8023) REST API doesn't show new application
[
https://issues.apache.org/jira/browse/YARN-8023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Airton Sampaio de Sobral updated YARN-8023:
---
Description:
After killing an application using the HADOOP UI, and creating a new one with
the same configuration, the brand new one doesn't appear on the API route:
/api/v1/applications?status=running
I've tried the applications path as well (/api/v1/applications) without success.
This happens randomly and it seems that after a really long time, the new
instance appears on the API.
On the UI the new application instance appears, and it's working fine. (Print
screen on attachment).
On the API it shows the last instance of the application as it's running, but
it's dead by one hour!
{code:java}
/api/v1/applications?status=running
{
"id" : "application_1511385973584_0087",
"name" : "AdActionPaymentKafkaToJDBC",
"attempts" : [ {
"attemptId" : "1",
"startTime" : "2018-01-16T19:08:32.275GMT",
"endTime" : "1969-12-31T23:59:59.999GMT",
"lastUpdated" : "2018-01-16T19:08:34.016GMT",
"duration" : 0,
"sparkUser" : "hadoop",
"completed" : false,
"endTimeEpoch" : -1,
"startTimeEpoch" : 1516129712275,
"lastUpdatedEpoch" : 1516129714016
}
{code}
Update:
After two hours, the application appeared on the API response:
{code:java}
{
"id" : "application_1511385973584_0154",
"name" : "AdActionPaymentKafkaToJDBC",
"attempts" : [ {
"attemptId" : "1",
"startTime" : "2018-03-10T21:08:30.557GMT",
"endTime" : "1969-12-31T23:59:59.999GMT",
"lastUpdated" : "2018-03-10T21:08:32.310GMT",
"duration" : 0,
"sparkUser" : "hadoop",
"completed" : false,
"endTimeEpoch" : -1,
"startTimeEpoch" : 1520716110557,
"lastUpdatedEpoch" : 1520716112310
}
{code}
was:
After killing an application using the HADOOP UI, and creating a new one with
the same configuration, the brand new one doesn't appear on the API route:
/api/v1/applications?status=running
I've tried the applications path as well (/api/v1/applications) without success.
This happens randomly and it seems that after a really long time, the new
instance appears on the API.
On the UI the new application instance appears, and it's working fine. (Print
screen on attachment).
On the API it shows the last instance of the application as it's running, but
it's dead by one hour!
{code:java}
/api/v1/applications?status=running
{
"id" : "application_1511385973584_0087",
"name" : "AdActionPaymentKafkaToJDBC",
"attempts" : [ {
"attemptId" : "1",
"startTime" : "2018-01-16T19:08:32.275GMT",
"endTime" : "1969-12-31T23:59:59.999GMT",
"lastUpdated" : "2018-01-16T19:08:34.016GMT",
"duration" : 0,
"sparkUser" : "hadoop",
"completed" : false,
"endTimeEpoch" : -1,
"startTimeEpoch" : 1516129712275,
"lastUpdatedEpoch" : 1516129714016
} ]
}
{code}
Update:
After two hours, the application appeared on the API response:
{code:java}
{
"id" : "application_1511385973584_0154",
"name" : "AdActionPaymentKafkaToJDBC",
"attempts" : [ {
"attemptId" : "1",
"startTime" : "2018-03-10T21:08:30.557GMT",
"endTime" : "1969-12-31T23:59:59.999GMT",
"lastUpdated" : "2018-03-10T21:08:32.310GMT",
"duration" : 0,
"sparkUser" : "hadoop",
"completed" : false,
"endTimeEpoch" : -1,
"startTimeEpoch" : 1520716110557,
"lastUpdatedEpoch" : 1520716112310
}
{code}
> REST API doesn't show new application
> -
>
> Key: YARN-8023
> URL: https://issues.apache.org/jira/browse/YARN-8023
> Project: Hadoop YARN
> Issue Type: Bug
> Components: api
>Affects Versions: 2.7.3
> Environment: Release label:emr-5.5.0
> Hadoop distribution:Amazon 2.7.3
> Applications:Spark 2.1.0, Hive 2.1.1, Hue 3.12.0
>Reporter: Airton Sampaio de Sobral
>Priority: Major
> Attachments: Screen Shot 2018-03-10 at 5.46.13 PM.png
>
>
> After killing an application using the HADOOP UI, and creating a new one with
> the same configuration, the brand new one doesn't appear on the API route:
> /api/v1/applications?status=running
> I've tried the applications path as well (/api/v1/applications) without
> success.
> This happens randomly and it seems that after a really long time, the new
> instance appears on the API.
> On the UI the new application instance appears, and it's working fine. (Print
> screen on attachment).
> On the API it shows the last instance of the application as it's running, but
> it's dead by one hour!
> {code:java}
> /api/v1/applications?status=running
> {
> "id" : "application_1511385973584_0087",
> "name" : "AdActionPaymentKafkaToJDBC",
> "attempts" : [ {
> "attemptId" : "1",
> "startTime" : "2018-01-16T19:08:32.275GMT",
> "endTime" : "1969-12-31T23:59:59.999GMT",
> "lastUpdated" : "2018-01-16T19:08:34.016GMT",
> "duration" : 0,
> "sparkUser" : "hadoop",
> "completed" : false,
> "endTimeEpoch" : -1,
> "startTimeEpoch" : 1516129712275,
> "lastUpdatedEpoch" : 1516129714016
