[jira] [Commented] (YARN-9404) TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails intermittent
[
https://issues.apache.org/jira/browse/YARN-9404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105453#comment-17105453
]
Jim Brennan commented on YARN-9404:
---
Thanks [~prabhujoseph]!
> TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails
> intermittent
>
>
> Key: YARN-9404
> URL: https://issues.apache.org/jira/browse/YARN-9404
> Project: Hadoop YARN
> Issue Type: Test
> Components: resourcemanager
>Affects Versions: 3.2.0
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
>Priority: Major
> Fix For: 3.3.0, 2.10.1
>
> Attachments: YARN-9404-001.patch
>
>
> TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails
> intermittent.
> {code}
> [ERROR]
> testApplicationLifetimeMonitor[0](org.apache.hadoop.yarn.server.resourcemanager.rmapp.TestApplicationLifetimeMonitor)
> Time elapsed: 34.75 s <<< FAILURE! java.lang.AssertionError: Application
> killed before lifetime value at org.junit.Assert.fail(Assert.java:88) at
> org.junit.Assert.assertTrue(Assert.java:41) at
> org.apache.hadoop.yarn.server.resourcemanager.rmapp.TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor(TestApplicationLifetimeMonitor.java:209)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498) at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
> java.lang.Thread.run(Thread.java:748)
> {code}
> As per testcase logs, submittime is 1553240813597 and finishtime is
> 1553240844372. The testcase does (finishtime - submittime) / 1000 = 30775 /
> 1000 = 30 and loses the decimal, 775 ms.
> {code}
> 2019-03-22 07:47:24,357 INFO [Ping Checker] util.AbstractLivelinessMonitor
> (AbstractLivelinessMonitor.java:run(149)) -
> Expired:application_1553240811329_0004_LIFETIME Timed out after 0 secs
> 2019-03-22 07:47:24,384 INFO [AsyncDispatcher event handler]
> resourcemanager.RMAppManager$ApplicationSummary
> (RMAppManager.java:logAppSummary(219)) -
> appId=application_1553240811329_0004,name=,user=jenkins,queue=default,state=KILLED,trackingUrl=http://869e1f448cdd:8088/cluster/app/application_1553240811329_0004,appMasterHost=N/A,submitTime=1553240813597,startTime=1553240813604,launchTime=0,finishTime=1553240844372,finalStatus=KILLED,memorySeconds=0,vcoreSeconds=0,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources= vCores:0>,applicationType=YARN,resourceSeconds=0 MB-seconds\, 0
> vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds
> {code}
> Testcase succeeds only when the seconds taken is above 30L.
> {code}
> long totalTimeRun =
> (app4.getFinishTime() - app4.getSubmitTime()) / 1000;
> Assert.assertTrue("Application killed before lifetime value",
> totalTimeRun > maxLifetime);
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-9404) TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails intermittent
[
https://issues.apache.org/jira/browse/YARN-9404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105123#comment-17105123
]
Prabhu Joseph commented on YARN-9404:
-
[~Jim_Brennan] Have cherry-picked this Jira to branch-2.10.
> TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails
> intermittent
>
>
> Key: YARN-9404
> URL: https://issues.apache.org/jira/browse/YARN-9404
> Project: Hadoop YARN
> Issue Type: Test
> Components: resourcemanager
>Affects Versions: 3.2.0
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
>Priority: Major
> Fix For: 3.3.0
>
> Attachments: YARN-9404-001.patch
>
>
> TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails
> intermittent.
> {code}
> [ERROR]
> testApplicationLifetimeMonitor[0](org.apache.hadoop.yarn.server.resourcemanager.rmapp.TestApplicationLifetimeMonitor)
> Time elapsed: 34.75 s <<< FAILURE! java.lang.AssertionError: Application
> killed before lifetime value at org.junit.Assert.fail(Assert.java:88) at
> org.junit.Assert.assertTrue(Assert.java:41) at
> org.apache.hadoop.yarn.server.resourcemanager.rmapp.TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor(TestApplicationLifetimeMonitor.java:209)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498) at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
> java.lang.Thread.run(Thread.java:748)
> {code}
> As per testcase logs, submittime is 1553240813597 and finishtime is
> 1553240844372. The testcase does (finishtime - submittime) / 1000 = 30775 /
> 1000 = 30 and loses the decimal, 775 ms.
> {code}
> 2019-03-22 07:47:24,357 INFO [Ping Checker] util.AbstractLivelinessMonitor
> (AbstractLivelinessMonitor.java:run(149)) -
> Expired:application_1553240811329_0004_LIFETIME Timed out after 0 secs
> 2019-03-22 07:47:24,384 INFO [AsyncDispatcher event handler]
> resourcemanager.RMAppManager$ApplicationSummary
> (RMAppManager.java:logAppSummary(219)) -
> appId=application_1553240811329_0004,name=,user=jenkins,queue=default,state=KILLED,trackingUrl=http://869e1f448cdd:8088/cluster/app/application_1553240811329_0004,appMasterHost=N/A,submitTime=1553240813597,startTime=1553240813604,launchTime=0,finishTime=1553240844372,finalStatus=KILLED,memorySeconds=0,vcoreSeconds=0,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources= vCores:0>,applicationType=YARN,resourceSeconds=0 MB-seconds\, 0
> vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds
> {code}
> Testcase succeeds only when the seconds taken is above 30L.
> {code}
> long totalTimeRun =
> (app4.getFinishTime() - app4.getSubmitTime()) / 1000;
> Assert.assertTrue("Application killed before lifetime value",
> totalTimeRun > maxLifetime);
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-9404) TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails intermittent
[
https://issues.apache.org/jira/browse/YARN-9404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096636#comment-17096636
]
Jim Brennan commented on YARN-9404:
---
[~prabhujoseph], [~giovanni.fumarola] we are seeing this failure in
branch-2.10. Any chance we could get this fix pulled back? I have verified
that the existing patch applies cleanly to branch-2.10, builds and runs and the
test passes.
> TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails
> intermittent
>
>
> Key: YARN-9404
> URL: https://issues.apache.org/jira/browse/YARN-9404
> Project: Hadoop YARN
> Issue Type: Test
> Components: resourcemanager
>Affects Versions: 3.2.0
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
>Priority: Major
> Fix For: 3.3.0
>
> Attachments: YARN-9404-001.patch
>
>
> TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails
> intermittent.
> {code}
> [ERROR]
> testApplicationLifetimeMonitor[0](org.apache.hadoop.yarn.server.resourcemanager.rmapp.TestApplicationLifetimeMonitor)
> Time elapsed: 34.75 s <<< FAILURE! java.lang.AssertionError: Application
> killed before lifetime value at org.junit.Assert.fail(Assert.java:88) at
> org.junit.Assert.assertTrue(Assert.java:41) at
> org.apache.hadoop.yarn.server.resourcemanager.rmapp.TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor(TestApplicationLifetimeMonitor.java:209)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498) at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
> java.lang.Thread.run(Thread.java:748)
> {code}
> As per testcase logs, submittime is 1553240813597 and finishtime is
> 1553240844372. The testcase does (finishtime - submittime) / 1000 = 30775 /
> 1000 = 30 and loses the decimal, 775 ms.
> {code}
> 2019-03-22 07:47:24,357 INFO [Ping Checker] util.AbstractLivelinessMonitor
> (AbstractLivelinessMonitor.java:run(149)) -
> Expired:application_1553240811329_0004_LIFETIME Timed out after 0 secs
> 2019-03-22 07:47:24,384 INFO [AsyncDispatcher event handler]
> resourcemanager.RMAppManager$ApplicationSummary
> (RMAppManager.java:logAppSummary(219)) -
> appId=application_1553240811329_0004,name=,user=jenkins,queue=default,state=KILLED,trackingUrl=http://869e1f448cdd:8088/cluster/app/application_1553240811329_0004,appMasterHost=N/A,submitTime=1553240813597,startTime=1553240813604,launchTime=0,finishTime=1553240844372,finalStatus=KILLED,memorySeconds=0,vcoreSeconds=0,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources= vCores:0>,applicationType=YARN,resourceSeconds=0 MB-seconds\, 0
> vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds
> {code}
> Testcase succeeds only when the seconds taken is above 30L.
> {code}
> long totalTimeRun =
> (app4.getFinishTime() - app4.getSubmitTime()) / 1000;
> Assert.assertTrue("Application killed before lifetime value",
> totalTimeRun > maxLifetime);
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-9404) TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails intermittent
[
https://issues.apache.org/jira/browse/YARN-9404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16799523#comment-16799523
]
Prabhu Joseph commented on YARN-9404:
-
Thanks [~giovanni.fumarola]!
> TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails
> intermittent
>
>
> Key: YARN-9404
> URL: https://issues.apache.org/jira/browse/YARN-9404
> Project: Hadoop YARN
> Issue Type: Test
> Components: resourcemanager
>Affects Versions: 3.2.0
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
>Priority: Major
> Fix For: 3.3.0
>
> Attachments: YARN-9404-001.patch
>
>
> TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails
> intermittent.
> {code}
> [ERROR]
> testApplicationLifetimeMonitor[0](org.apache.hadoop.yarn.server.resourcemanager.rmapp.TestApplicationLifetimeMonitor)
> Time elapsed: 34.75 s <<< FAILURE! java.lang.AssertionError: Application
> killed before lifetime value at org.junit.Assert.fail(Assert.java:88) at
> org.junit.Assert.assertTrue(Assert.java:41) at
> org.apache.hadoop.yarn.server.resourcemanager.rmapp.TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor(TestApplicationLifetimeMonitor.java:209)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498) at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
> java.lang.Thread.run(Thread.java:748)
> {code}
> As per testcase logs, submittime is 1553240813597 and finishtime is
> 1553240844372. The testcase does (finishtime - submittime) / 1000 = 30775 /
> 1000 = 30 and loses the decimal, 775 ms.
> {code}
> 2019-03-22 07:47:24,357 INFO [Ping Checker] util.AbstractLivelinessMonitor
> (AbstractLivelinessMonitor.java:run(149)) -
> Expired:application_1553240811329_0004_LIFETIME Timed out after 0 secs
> 2019-03-22 07:47:24,384 INFO [AsyncDispatcher event handler]
> resourcemanager.RMAppManager$ApplicationSummary
> (RMAppManager.java:logAppSummary(219)) -
> appId=application_1553240811329_0004,name=,user=jenkins,queue=default,state=KILLED,trackingUrl=http://869e1f448cdd:8088/cluster/app/application_1553240811329_0004,appMasterHost=N/A,submitTime=1553240813597,startTime=1553240813604,launchTime=0,finishTime=1553240844372,finalStatus=KILLED,memorySeconds=0,vcoreSeconds=0,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources= vCores:0>,applicationType=YARN,resourceSeconds=0 MB-seconds\, 0
> vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds
> {code}
> Testcase succeeds only when the seconds taken is above 30L.
> {code}
> long totalTimeRun =
> (app4.getFinishTime() - app4.getSubmitTime()) / 1000;
> Assert.assertTrue("Application killed before lifetime value",
> totalTimeRun > maxLifetime);
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-9404) TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails intermittent
[
https://issues.apache.org/jira/browse/YARN-9404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16799269#comment-16799269
]
Hudson commented on YARN-9404:
--
SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #16265 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/16265/])
YARN-9404. TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor
(gifuma: rev 509b20b292465ea0c8a2a0908995421e29e71da4)
* (edit)
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/TestApplicationLifetimeMonitor.java
> TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails
> intermittent
>
>
> Key: YARN-9404
> URL: https://issues.apache.org/jira/browse/YARN-9404
> Project: Hadoop YARN
> Issue Type: Test
> Components: resourcemanager
>Affects Versions: 3.2.0
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
>Priority: Major
> Fix For: 3.3.0
>
> Attachments: YARN-9404-001.patch
>
>
> TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails
> intermittent.
> {code}
> [ERROR]
> testApplicationLifetimeMonitor[0](org.apache.hadoop.yarn.server.resourcemanager.rmapp.TestApplicationLifetimeMonitor)
> Time elapsed: 34.75 s <<< FAILURE! java.lang.AssertionError: Application
> killed before lifetime value at org.junit.Assert.fail(Assert.java:88) at
> org.junit.Assert.assertTrue(Assert.java:41) at
> org.apache.hadoop.yarn.server.resourcemanager.rmapp.TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor(TestApplicationLifetimeMonitor.java:209)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498) at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
> java.lang.Thread.run(Thread.java:748)
> {code}
> As per testcase logs, submittime is 1553240813597 and finishtime is
> 1553240844372. The testcase does (finishtime - submittime) / 1000 = 30775 /
> 1000 = 30 and loses the decimal, 775 ms.
> {code}
> 2019-03-22 07:47:24,357 INFO [Ping Checker] util.AbstractLivelinessMonitor
> (AbstractLivelinessMonitor.java:run(149)) -
> Expired:application_1553240811329_0004_LIFETIME Timed out after 0 secs
> 2019-03-22 07:47:24,384 INFO [AsyncDispatcher event handler]
> resourcemanager.RMAppManager$ApplicationSummary
> (RMAppManager.java:logAppSummary(219)) -
> appId=application_1553240811329_0004,name=,user=jenkins,queue=default,state=KILLED,trackingUrl=http://869e1f448cdd:8088/cluster/app/application_1553240811329_0004,appMasterHost=N/A,submitTime=1553240813597,startTime=1553240813604,launchTime=0,finishTime=1553240844372,finalStatus=KILLED,memorySeconds=0,vcoreSeconds=0,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources= vCores:0>,applicationType=YARN,resourceSeconds=0 MB-seconds\, 0
> vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds
> {code}
> Testcase succeeds only when the seconds taken is above 30L.
> {code}
> long totalTimeRun =
> (app4.getFinishTime() - app4.getSubmitTime()) / 1000;
> Assert.assertTrue("Application killed before lifetime value",
> totalTimeRun > maxLifetime);
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-9404) TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails intermittent
[
https://issues.apache.org/jira/browse/YARN-9404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16799261#comment-16799261
]
Giovanni Matteo Fumarola commented on YARN-9404:
Committed to trunk.
Thanks [~Prabhu Joseph]
> TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails
> intermittent
>
>
> Key: YARN-9404
> URL: https://issues.apache.org/jira/browse/YARN-9404
> Project: Hadoop YARN
> Issue Type: Test
> Components: resourcemanager
>Affects Versions: 3.2.0
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
>Priority: Major
> Fix For: 3.3.0
>
> Attachments: YARN-9404-001.patch
>
>
> TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails
> intermittent.
> {code}
> [ERROR]
> testApplicationLifetimeMonitor[0](org.apache.hadoop.yarn.server.resourcemanager.rmapp.TestApplicationLifetimeMonitor)
> Time elapsed: 34.75 s <<< FAILURE! java.lang.AssertionError: Application
> killed before lifetime value at org.junit.Assert.fail(Assert.java:88) at
> org.junit.Assert.assertTrue(Assert.java:41) at
> org.apache.hadoop.yarn.server.resourcemanager.rmapp.TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor(TestApplicationLifetimeMonitor.java:209)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498) at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
> java.lang.Thread.run(Thread.java:748)
> {code}
> As per testcase logs, submittime is 1553240813597 and finishtime is
> 1553240844372. The testcase does (finishtime - submittime) / 1000 = 30775 /
> 1000 = 30 and loses the decimal, 775 ms.
> {code}
> 2019-03-22 07:47:24,357 INFO [Ping Checker] util.AbstractLivelinessMonitor
> (AbstractLivelinessMonitor.java:run(149)) -
> Expired:application_1553240811329_0004_LIFETIME Timed out after 0 secs
> 2019-03-22 07:47:24,384 INFO [AsyncDispatcher event handler]
> resourcemanager.RMAppManager$ApplicationSummary
> (RMAppManager.java:logAppSummary(219)) -
> appId=application_1553240811329_0004,name=,user=jenkins,queue=default,state=KILLED,trackingUrl=http://869e1f448cdd:8088/cluster/app/application_1553240811329_0004,appMasterHost=N/A,submitTime=1553240813597,startTime=1553240813604,launchTime=0,finishTime=1553240844372,finalStatus=KILLED,memorySeconds=0,vcoreSeconds=0,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources= vCores:0>,applicationType=YARN,resourceSeconds=0 MB-seconds\, 0
> vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds
> {code}
> Testcase succeeds only when the seconds taken is above 30L.
> {code}
> long totalTimeRun =
> (app4.getFinishTime() - app4.getSubmitTime()) / 1000;
> Assert.assertTrue("Application killed before lifetime value",
> totalTimeRun > maxLifetime);
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-9404) TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails intermittent
[
https://issues.apache.org/jira/browse/YARN-9404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16799225#comment-16799225
]
Hadoop QA commented on YARN-9404:
-
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
32s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 20m
38s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
56s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
44s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m
57s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
13m 23s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
31s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
33s{color} | {color:green} trunk passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
52s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
51s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
51s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
38s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
0s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
12m 21s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
20s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
26s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 81m
53s{color} | {color:green} hadoop-yarn-server-resourcemanager in the patch
passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
27s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}138m 35s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:8f97d6f |
| JIRA Issue | YARN-9404 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12963420/YARN-9404-001.patch |
| Optional Tests | dupname asflicense compile javac javadoc mvninstall
mvnsite unit shadedclient findbugs checkstyle |
| uname | Linux c08dc9ec36d7 4.4.0-138-generic #164~14.04.1-Ubuntu SMP Fri Oct
5 08:56:16 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/patchprocess/precommit/personality/provided.sh |
| git revision | trunk / ae2eb2d |
| maven | version: Apache Maven 3.3.9 |
| Default Java | 1.8.0_191 |
| findbugs | v3.1.0-RC1 |
| Test Results |
https://builds.apache.org/job/PreCommit-YARN-Build/23787/testReport/ |
| Max. process+thread count | 956 (vs. ulimit of 1) |
| modules | C:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
U:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
|
| Console output |
https://builds.apache.org/job/PreCommit-YARN-Build/23787/console |
| Powered by | Apache Yetus 0.8.0 http://yetus.apache.org |
This message was automatically generated.
>
[jira] [Commented] (YARN-9404) TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails intermittent
[
https://issues.apache.org/jira/browse/YARN-9404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16799222#comment-16799222
]
Giovanni Matteo Fumarola commented on YARN-9404:
LGTM +1.
Waiting on Yetus.
> TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails
> intermittent
>
>
> Key: YARN-9404
> URL: https://issues.apache.org/jira/browse/YARN-9404
> Project: Hadoop YARN
> Issue Type: Test
> Components: resourcemanager
>Affects Versions: 3.2.0
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
>Priority: Major
> Attachments: YARN-9404-001.patch
>
>
> TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails
> intermittent.
> {code}
> [ERROR]
> testApplicationLifetimeMonitor[0](org.apache.hadoop.yarn.server.resourcemanager.rmapp.TestApplicationLifetimeMonitor)
> Time elapsed: 34.75 s <<< FAILURE! java.lang.AssertionError: Application
> killed before lifetime value at org.junit.Assert.fail(Assert.java:88) at
> org.junit.Assert.assertTrue(Assert.java:41) at
> org.apache.hadoop.yarn.server.resourcemanager.rmapp.TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor(TestApplicationLifetimeMonitor.java:209)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498) at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
> java.lang.Thread.run(Thread.java:748)
> {code}
> As per testcase logs, submittime is 1553240813597 and finishtime is
> 1553240844372. The testcase does (finishtime - submittime) / 1000 = 30775 /
> 1000 = 30 and loses the decimal, 775 ms.
> {code}
> 2019-03-22 07:47:24,357 INFO [Ping Checker] util.AbstractLivelinessMonitor
> (AbstractLivelinessMonitor.java:run(149)) -
> Expired:application_1553240811329_0004_LIFETIME Timed out after 0 secs
> 2019-03-22 07:47:24,384 INFO [AsyncDispatcher event handler]
> resourcemanager.RMAppManager$ApplicationSummary
> (RMAppManager.java:logAppSummary(219)) -
> appId=application_1553240811329_0004,name=,user=jenkins,queue=default,state=KILLED,trackingUrl=http://869e1f448cdd:8088/cluster/app/application_1553240811329_0004,appMasterHost=N/A,submitTime=1553240813597,startTime=1553240813604,launchTime=0,finishTime=1553240844372,finalStatus=KILLED,memorySeconds=0,vcoreSeconds=0,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources= vCores:0>,applicationType=YARN,resourceSeconds=0 MB-seconds\, 0
> vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds
> {code}
> Testcase succeeds only when the seconds taken is above 30L.
> {code}
> long totalTimeRun =
> (app4.getFinishTime() - app4.getSubmitTime()) / 1000;
> Assert.assertTrue("Application killed before lifetime value",
> totalTimeRun > maxLifetime);
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
