Jira: https://issues.apache.org/jira/browse/TEZ-3247
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1743/
###################################################################################
########################## LAST 60 LINES OF THE CONSOLE
###########################
[...truncated 4456 lines...]
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12805049/TEZ-3247.2.patch
against master revision b3712f8.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 3.0.1) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in :
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleInputEventHandlerOrderedGrouped
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler
org.apache.tez.test.TestTezJobs
org.apache.tez.test.TestPipelinedShuffle
org.apache.tez.mapreduce.TestMRRJobsDAGApi
org.apache.tez.test.TestLocalMode
org.apache.tez.tests.TestExternalTezServices
org.apache.tez.tests.TestExtServicesWithLocalMode
Test results:
https://builds.apache.org/job/PreCommit-TEZ-Build/1743//testReport/
Console output: https://builds.apache.org/job/PreCommit-TEZ-Build/1743//console
This message is automatically generated.
======================================================================
======================================================================
Adding comment to Jira.
======================================================================
======================================================================
Comment added.
04d98d5535f2ce11590a84cf374da02aeb6eb92c logged out
======================================================================
======================================================================
Finished build.
======================================================================
======================================================================
Build step 'Execute shell' marked build as failure
Archiving artifacts
Compressed 3.23 MB of artifacts by 28.0% relative to #1738
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
###################################################################################
############################## FAILED TESTS (if any)
##############################
34 tests failed.
FAILED: org.apache.tez.tests.TestExtServicesWithLocalMode.test1
Error Message:
expected:<0> but was:<-1>
Stack Trace:
java.lang.AssertionError: expected:<0> but was:<-1>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at
org.apache.tez.tests.TestExtServicesWithLocalMode.runJoinValidate(TestExtServicesWithLocalMode.java:200)
at
org.apache.tez.tests.TestExtServicesWithLocalMode.test1(TestExtServicesWithLocalMode.java:166)
FAILED: org.apache.tez.tests.TestExternalTezServices.testAllInContainers
Error Message:
expected:<0> but was:<-1>
Stack Trace:
java.lang.AssertionError: expected:<0> but was:<-1>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at
org.apache.tez.tests.TestExternalTezServices.runJoinValidate(TestExternalTezServices.java:219)
at
org.apache.tez.tests.TestExternalTezServices.testAllInContainers(TestExternalTezServices.java:125)
FAILED: org.apache.tez.tests.TestExternalTezServices.testAllInAM
Error Message:
expected:<0> but was:<-1>
Stack Trace:
java.lang.AssertionError: expected:<0> but was:<-1>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at
org.apache.tez.tests.TestExternalTezServices.runJoinValidate(TestExternalTezServices.java:219)
at
org.apache.tez.tests.TestExternalTezServices.testAllInAM(TestExternalTezServices.java:132)
FAILED: org.apache.tez.tests.TestExternalTezServices.testMixed1
Error Message:
expected:<0> but was:<-1>
Stack Trace:
java.lang.AssertionError: expected:<0> but was:<-1>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at
org.apache.tez.tests.TestExternalTezServices.runJoinValidate(TestExternalTezServices.java:219)
at
org.apache.tez.tests.TestExternalTezServices.testMixed1(TestExternalTezServices.java:139)
FAILED: org.apache.tez.tests.TestExternalTezServices.testMixed3
Error Message:
expected:<0> but was:<-1>
Stack Trace:
java.lang.AssertionError: expected:<0> but was:<-1>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at
org.apache.tez.tests.TestExternalTezServices.runJoinValidate(TestExternalTezServices.java:219)
at
org.apache.tez.tests.TestExternalTezServices.testMixed3(TestExternalTezServices.java:153)
FAILED: org.apache.tez.tests.TestExternalTezServices.testMixed4
Error Message:
expected:<0> but was:<-1>
Stack Trace:
java.lang.AssertionError: expected:<0> but was:<-1>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at
org.apache.tez.tests.TestExternalTezServices.runJoinValidate(TestExternalTezServices.java:219)
at
org.apache.tez.tests.TestExternalTezServices.testMixed4(TestExternalTezServices.java:160)
FAILED: org.apache.tez.tests.TestExternalTezServices.testMixed5
Error Message:
expected:<0> but was:<-1>
Stack Trace:
java.lang.AssertionError: expected:<0> but was:<-1>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at
org.apache.tez.tests.TestExternalTezServices.runJoinValidate(TestExternalTezServices.java:219)
at
org.apache.tez.tests.TestExternalTezServices.testMixed5(TestExternalTezServices.java:167)
FAILED: org.apache.tez.tests.TestExternalTezServices.testMixed6
Error Message:
test timed out after 60000 milliseconds
Stack Trace:
java.lang.Exception: test timed out after 60000 milliseconds
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:503)
at org.apache.hadoop.ipc.Client.call(Client.java:1454)
at org.apache.hadoop.ipc.Client.call(Client.java:1399)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy92.getDAGStatus(Unknown Source)
at
org.apache.tez.dag.api.client.rpc.DAGClientRPCImpl.getDAGStatusViaAM(DAGClientRPCImpl.java:190)
at
org.apache.tez.dag.api.client.rpc.DAGClientRPCImpl.getDAGStatus(DAGClientRPCImpl.java:98)
at
org.apache.tez.dag.api.client.DAGClientImpl.getDAGStatusViaAM(DAGClientImpl.java:360)
at
org.apache.tez.dag.api.client.DAGClientImpl.getDAGStatusInternal(DAGClientImpl.java:220)
at
org.apache.tez.dag.api.client.DAGClientImpl.getDAGStatus(DAGClientImpl.java:207)
at
org.apache.tez.dag.api.client.DAGClientImpl._waitForCompletionWithStatusUpdates(DAGClientImpl.java:529)
at
org.apache.tez.dag.api.client.DAGClientImpl.waitForCompletionWithStatusUpdates(DAGClientImpl.java:338)
at org.apache.tez.examples.JoinValidate.runJob(JoinValidate.java:106)
at
org.apache.tez.examples.TezExampleBase._execute(TezExampleBase.java:232)
at org.apache.tez.examples.TezExampleBase.run(TezExampleBase.java:150)
at
org.apache.tez.tests.TestExternalTezServices.runJoinValidate(TestExternalTezServices.java:219)
at
org.apache.tez.tests.TestExternalTezServices.testMixed6(TestExternalTezServices.java:174)
FAILED: org.apache.tez.tests.TestExternalTezServices.testMixed7
Error Message:
test timed out after 60000 milliseconds
Stack Trace:
java.lang.Exception: test timed out after 60000 milliseconds
at java.lang.Thread.sleep(Native Method)
at org.apache.tez.client.TezClient.waitTillReady(TezClient.java:921)
at org.apache.tez.client.TezClient.waitTillReady(TezClient.java:883)
at org.apache.tez.examples.JoinValidate.runJob(JoinValidate.java:100)
at
org.apache.tez.examples.TezExampleBase._execute(TezExampleBase.java:232)
at org.apache.tez.examples.TezExampleBase.run(TezExampleBase.java:150)
at
org.apache.tez.tests.TestExternalTezServices.runJoinValidate(TestExternalTezServices.java:219)
at
org.apache.tez.tests.TestExternalTezServices.testMixed7(TestExternalTezServices.java:181)
FAILED:
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleInputEventHandlerOrderedGrouped.testAllPartitionsEmpty
Error Message:
Metrics source shuffleInput already exists!
Stack Trace:
org.apache.hadoop.metrics2.MetricsException: Metrics source shuffleInput
already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at
org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleInputEventHandlerOrderedGrouped.setupScheduler(TestShuffleInputEventHandlerOrderedGrouped.java:143)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleInputEventHandlerOrderedGrouped.setup(TestShuffleInputEventHandlerOrderedGrouped.java:137)
FAILED:
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleInputEventHandlerOrderedGrouped.testCurrentPartitionEmpty
Error Message:
Metrics source shuffleInput already exists!
Stack Trace:
org.apache.hadoop.metrics2.MetricsException: Metrics source shuffleInput
already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at
org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleInputEventHandlerOrderedGrouped.setupScheduler(TestShuffleInputEventHandlerOrderedGrouped.java:143)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleInputEventHandlerOrderedGrouped.setup(TestShuffleInputEventHandlerOrderedGrouped.java:137)
FAILED:
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleInputEventHandlerOrderedGrouped.testFailedEvent
Error Message:
Metrics source shuffleInput already exists!
Stack Trace:
org.apache.hadoop.metrics2.MetricsException: Metrics source shuffleInput
already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at
org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleInputEventHandlerOrderedGrouped.setupScheduler(TestShuffleInputEventHandlerOrderedGrouped.java:143)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleInputEventHandlerOrderedGrouped.setup(TestShuffleInputEventHandlerOrderedGrouped.java:137)
FAILED:
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleInputEventHandlerOrderedGrouped.testOtherPartitionEmpty
Error Message:
Metrics source shuffleInput already exists!
Stack Trace:
org.apache.hadoop.metrics2.MetricsException: Metrics source shuffleInput
already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at
org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleInputEventHandlerOrderedGrouped.setupScheduler(TestShuffleInputEventHandlerOrderedGrouped.java:143)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleInputEventHandlerOrderedGrouped.setup(TestShuffleInputEventHandlerOrderedGrouped.java:137)
FAILED:
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleInputEventHandlerOrderedGrouped.testPiplinedShuffleEvents
Error Message:
Metrics source shuffleInput already exists!
Stack Trace:
org.apache.hadoop.metrics2.MetricsException: Metrics source shuffleInput
already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at
org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleInputEventHandlerOrderedGrouped.setupScheduler(TestShuffleInputEventHandlerOrderedGrouped.java:143)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleInputEventHandlerOrderedGrouped.setup(TestShuffleInputEventHandlerOrderedGrouped.java:137)
FAILED:
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleInputEventHandlerOrderedGrouped.testPiplinedShuffleEvents_WithOutofOrderAttempts
Error Message:
Metrics source shuffleInput already exists!
Stack Trace:
org.apache.hadoop.metrics2.MetricsException: Metrics source shuffleInput
already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at
org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleInputEventHandlerOrderedGrouped.setupScheduler(TestShuffleInputEventHandlerOrderedGrouped.java:143)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleInputEventHandlerOrderedGrouped.setup(TestShuffleInputEventHandlerOrderedGrouped.java:137)
FAILED:
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.testReducerHealth_1
Error Message:
Metrics source shuffleInput already exists!
Stack Trace:
org.apache.hadoop.metrics2.MetricsException: Metrics source shuffleInput
already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at
org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler$ShuffleSchedulerForTest.<init>(TestShuffleScheduler.java:878)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler$ShuffleSchedulerForTest.<init>(TestShuffleScheduler.java:866)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.createScheduler(TestShuffleScheduler.java:737)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler._testReducerHealth_1(TestShuffleScheduler.java:185)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.testReducerHealth_1(TestShuffleScheduler.java:176)
FAILED:
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.testReducerHealth_2
Error Message:
Metrics source shuffleInput already exists!
Stack Trace:
org.apache.hadoop.metrics2.MetricsException: Metrics source shuffleInput
already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at
org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler$ShuffleSchedulerForTest.<init>(TestShuffleScheduler.java:878)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler$ShuffleSchedulerForTest.<init>(TestShuffleScheduler.java:866)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.createScheduler(TestShuffleScheduler.java:737)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.createScheduler(TestShuffleScheduler.java:745)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.testReducerHealth_2(TestShuffleScheduler.java:255)
FAILED:
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.testReducerHealth_3
Error Message:
Metrics source shuffleInput already exists!
Stack Trace:
org.apache.hadoop.metrics2.MetricsException: Metrics source shuffleInput
already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at
org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler$ShuffleSchedulerForTest.<init>(TestShuffleScheduler.java:878)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler$ShuffleSchedulerForTest.<init>(TestShuffleScheduler.java:866)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.createScheduler(TestShuffleScheduler.java:737)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.createScheduler(TestShuffleScheduler.java:745)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.testReducerHealth_3(TestShuffleScheduler.java:371)
FAILED:
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.testReducerHealth_4
Error Message:
Metrics source shuffleInput already exists!
Stack Trace:
org.apache.hadoop.metrics2.MetricsException: Metrics source shuffleInput
already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at
org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler$ShuffleSchedulerForTest.<init>(TestShuffleScheduler.java:878)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler$ShuffleSchedulerForTest.<init>(TestShuffleScheduler.java:866)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.createScheduler(TestShuffleScheduler.java:737)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.createScheduler(TestShuffleScheduler.java:745)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.testReducerHealth_4(TestShuffleScheduler.java:436)
FAILED:
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.testReducerHealth_5
Error Message:
Metrics source shuffleInput already exists!
Stack Trace:
org.apache.hadoop.metrics2.MetricsException: Metrics source shuffleInput
already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at
org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler$ShuffleSchedulerForTest.<init>(TestShuffleScheduler.java:878)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler$ShuffleSchedulerForTest.<init>(TestShuffleScheduler.java:866)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.createScheduler(TestShuffleScheduler.java:737)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.createScheduler(TestShuffleScheduler.java:745)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.testReducerHealth_5(TestShuffleScheduler.java:531)
FAILED:
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.testReducerHealth_6
Error Message:
Metrics source shuffleInput already exists!
Stack Trace:
org.apache.hadoop.metrics2.MetricsException: Metrics source shuffleInput
already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at
org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler$ShuffleSchedulerForTest.<init>(TestShuffleScheduler.java:878)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler$ShuffleSchedulerForTest.<init>(TestShuffleScheduler.java:866)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.createScheduler(TestShuffleScheduler.java:737)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler._testReducerHealth_6(TestShuffleScheduler.java:609)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.testReducerHealth_6(TestShuffleScheduler.java:597)
FAILED:
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.testReducerHealth_7
Error Message:
Metrics source shuffleInput already exists!
Stack Trace:
org.apache.hadoop.metrics2.MetricsException: Metrics source shuffleInput
already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at
org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler$ShuffleSchedulerForTest.<init>(TestShuffleScheduler.java:878)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler$ShuffleSchedulerForTest.<init>(TestShuffleScheduler.java:866)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.createScheduler(TestShuffleScheduler.java:737)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.createScheduler(TestShuffleScheduler.java:745)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.testReducerHealth_7(TestShuffleScheduler.java:686)
FAILED:
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.testPenalty
Error Message:
Metrics source shuffleInput already exists!
Stack Trace:
org.apache.hadoop.metrics2.MetricsException: Metrics source shuffleInput
already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at
org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler$ShuffleSchedulerForTest.<init>(TestShuffleScheduler.java:878)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler$ShuffleSchedulerForTest.<init>(TestShuffleScheduler.java:866)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.createScheduler(TestShuffleScheduler.java:737)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.createScheduler(TestShuffleScheduler.java:745)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.testPenalty(TestShuffleScheduler.java:753)
FAILED:
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.testNumParallelScheduledFetchers
Error Message:
Metrics source shuffleInput already exists!
Stack Trace:
org.apache.hadoop.metrics2.MetricsException: Metrics source shuffleInput
already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at
org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler$ShuffleSchedulerForTest.<init>(TestShuffleScheduler.java:878)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.testNumParallelScheduledFetchers(TestShuffleScheduler.java:70)
FAILED:
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.testShutdown
Error Message:
Metrics source shuffleInput already exists!
Stack Trace:
org.apache.hadoop.metrics2.MetricsException: Metrics source shuffleInput
already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at
org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler$ShuffleSchedulerForTest.<init>(TestShuffleScheduler.java:878)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler$ShuffleSchedulerForTest.<init>(TestShuffleScheduler.java:866)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestShuffleScheduler.testShutdown(TestShuffleScheduler.java:785)
FAILED: org.apache.tez.mapreduce.TestMRRJobsDAGApi.testVertexGroups
Error Message:
VertexGroups Test Failed
Stack Trace:
org.apache.tez.dag.api.TezUncheckedException: VertexGroups Test Failed
at
org.apache.tez.mapreduce.TestMRRJobsDAGApi.testVertexGroups(TestMRRJobsDAGApi.java:802)
FAILED: org.apache.tez.test.TestLocalMode.testMultiDAGsOnSession
Error Message:
Iteration 0 failed with diagnostics: [Vertex failed, vertexName=Sorter,
vertexId=vertex_1463698538903_0001_1_02, diagnostics=[Task failed,
taskId=task_1463698538903_0001_1_02_000000, diagnostics=[TaskAttempt 0 failed,
info=[Error: Error while running task ( failure ) :
attempt_1463698538903_0001_1_02_000000_0:org.apache.hadoop.metrics2.MetricsException:
Metrics source shuffleInput already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.Shuffle.<init>(Shuffle.java:170)
at
org.apache.tez.runtime.library.input.OrderedGroupedKVInput.createShuffle(OrderedGroupedKVInput.java:147)
at
org.apache.tez.runtime.library.input.OrderedGroupedKVInput.start(OrderedGroupedKVInput.java:127)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable._callInternal(LogicalIOProcessorRuntimeTask.java:495)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:484)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:470)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
], TaskAttempt 1 failed, info=[Error: Error while running task ( failure ) :
attempt_1463698538903_0001_1_02_000000_1:org.apache.hadoop.metrics2.MetricsException:
Metrics source shuffleInput already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.Shuffle.<init>(Shuffle.java:170)
at
org.apache.tez.runtime.library.input.OrderedGroupedKVInput.createShuffle(OrderedGroupedKVInput.java:147)
at
org.apache.tez.runtime.library.input.OrderedGroupedKVInput.start(OrderedGroupedKVInput.java:127)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable._callInternal(LogicalIOProcessorRuntimeTask.java:495)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:484)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:470)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
], TaskAttempt 2 failed, info=[Error: Error while running task ( failure ) :
attempt_1463698538903_0001_1_02_000000_2:org.apache.hadoop.metrics2.MetricsException:
Metrics source shuffleInput already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.Shuffle.<init>(Shuffle.java:170)
at
org.apache.tez.runtime.library.input.OrderedGroupedKVInput.createShuffle(OrderedGroupedKVInput.java:147)
at
org.apache.tez.runtime.library.input.OrderedGroupedKVInput.start(OrderedGroupedKVInput.java:127)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable._callInternal(LogicalIOProcessorRuntimeTask.java:495)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:484)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:470)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
], TaskAttempt 3 failed, info=[Error: Error while running task ( failure ) :
attempt_1463698538903_0001_1_02_000000_3:org.apache.hadoop.metrics2.MetricsException:
Metrics source shuffleInput already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.Shuffle.<init>(Shuffle.java:170)
at
org.apache.tez.runtime.library.input.OrderedGroupedKVInput.createShuffle(OrderedGroupedKVInput.java:147)
at
org.apache.tez.runtime.library.input.OrderedGroupedKVInput.start(OrderedGroupedKVInput.java:127)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable._callInternal(LogicalIOProcessorRuntimeTask.java:495)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:484)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:470)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1
killedTasks:0, Vertex vertex_1463698538903_0001_1_02 [Sorter] killed/failed due
to:OWN_TASK_FAILURE], DAG did not succeed due to VERTEX_FAILURE.
failedVertices:1 killedVertices:0]
Stack Trace:
java.lang.AssertionError: Iteration 0 failed with diagnostics: [Vertex failed,
vertexName=Sorter, vertexId=vertex_1463698538903_0001_1_02, diagnostics=[Task
failed, taskId=task_1463698538903_0001_1_02_000000, diagnostics=[TaskAttempt 0
failed, info=[Error: Error while running task ( failure ) :
attempt_1463698538903_0001_1_02_000000_0:org.apache.hadoop.metrics2.MetricsException:
Metrics source shuffleInput already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at
org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.Shuffle.<init>(Shuffle.java:170)
at
org.apache.tez.runtime.library.input.OrderedGroupedKVInput.createShuffle(OrderedGroupedKVInput.java:147)
at
org.apache.tez.runtime.library.input.OrderedGroupedKVInput.start(OrderedGroupedKVInput.java:127)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable._callInternal(LogicalIOProcessorRuntimeTask.java:495)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:484)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:470)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
], TaskAttempt 1 failed, info=[Error: Error while running task ( failure ) :
attempt_1463698538903_0001_1_02_000000_1:org.apache.hadoop.metrics2.MetricsException:
Metrics source shuffleInput already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at
org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.Shuffle.<init>(Shuffle.java:170)
at
org.apache.tez.runtime.library.input.OrderedGroupedKVInput.createShuffle(OrderedGroupedKVInput.java:147)
at
org.apache.tez.runtime.library.input.OrderedGroupedKVInput.start(OrderedGroupedKVInput.java:127)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable._callInternal(LogicalIOProcessorRuntimeTask.java:495)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:484)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:470)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
], TaskAttempt 2 failed, info=[Error: Error while running task ( failure ) :
attempt_1463698538903_0001_1_02_000000_2:org.apache.hadoop.metrics2.MetricsException:
Metrics source shuffleInput already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at
org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.Shuffle.<init>(Shuffle.java:170)
at
org.apache.tez.runtime.library.input.OrderedGroupedKVInput.createShuffle(OrderedGroupedKVInput.java:147)
at
org.apache.tez.runtime.library.input.OrderedGroupedKVInput.start(OrderedGroupedKVInput.java:127)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable._callInternal(LogicalIOProcessorRuntimeTask.java:495)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:484)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:470)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
], TaskAttempt 3 failed, info=[Error: Error while running task ( failure ) :
attempt_1463698538903_0001_1_02_000000_3:org.apache.hadoop.metrics2.MetricsException:
Metrics source shuffleInput already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:135)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:112)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:228)
at
org.apache.hadoop.metrics2.MetricsSystem.register(MetricsSystem.java:60)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleClientMetrics.create(ShuffleClientMetrics.java:77)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleScheduler.<init>(ShuffleScheduler.java:368)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.Shuffle.<init>(Shuffle.java:170)
at
org.apache.tez.runtime.library.input.OrderedGroupedKVInput.createShuffle(OrderedGroupedKVInput.java:147)
at
org.apache.tez.runtime.library.input.OrderedGroupedKVInput.start(OrderedGroupedKVInput.java:127)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable._callInternal(LogicalIOProcessorRuntimeTask.java:495)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:484)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$StartInputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:470)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1
killedTasks:0, Vertex vertex_1463698538903_0001_1_02 [Sorter] killed/failed due
to:OWN_TASK_FAILURE], DAG did not succeed due to VERTEX_FAILURE.
failedVertices:1 killedVertices:0]
at org.junit.Assert.fail(Assert.java:88)
at
org.apache.tez.test.TestLocalMode.testMultiDAGsOnSession(TestLocalMode.java:242)
FAILED: org.apache.tez.test.TestPipelinedShuffle.baseTest
Error Message:
expected:<0> but was:<-1>
Stack Trace:
java.lang.AssertionError: expected:<0> but was:<-1>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at
org.apache.tez.test.TestPipelinedShuffle.test(TestPipelinedShuffle.java:144)
at
org.apache.tez.test.TestPipelinedShuffle.baseTest(TestPipelinedShuffle.java:132)
FAILED: org.apache.tez.test.TestTezJobs.testMultipleCommits_OnDAGSuccess
Error Message:
MultipleCommitsExample failed
Stack Trace:
java.lang.AssertionError: MultipleCommitsExample failed
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at
org.apache.tez.test.TestTezJobs.testMultipleCommits_OnDAGSuccess(TestTezJobs.java:951)
FAILED: org.apache.tez.test.TestTezJobs.testMultipleCommits_OnVertexSuccess
Error Message:
MultipleCommitsExample failed
Stack Trace:
java.lang.AssertionError: MultipleCommitsExample failed
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at
org.apache.tez.test.TestTezJobs.testMultipleCommits_OnVertexSuccess(TestTezJobs.java:984)
FAILED: org.apache.tez.test.TestTezJobs.testHashJoinExamplePipeline
Error Message:
expected:<0> but was:<-1>
Stack Trace:
java.lang.AssertionError: expected:<0> but was:<-1>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at
org.apache.tez.test.TestTezJobs.testHashJoinExamplePipeline(TestTezJobs.java:519)
FAILED: org.apache.tez.test.TestTezJobs.testSortMergeJoinExamplePipeline
Error Message:
expected:<0> but was:<-1>
Stack Trace:
java.lang.AssertionError: expected:<0> but was:<-1>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at
org.apache.tez.test.TestTezJobs.testSortMergeJoinExamplePipeline(TestTezJobs.java:562)
FAILED: org.apache.tez.test.TestTezJobs.testPerIOCounterAggregation
Error Message:
expected:<0> but was:<-1>
Stack Trace:
java.lang.AssertionError: expected:<0> but was:<-1>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at
org.apache.tez.test.TestTezJobs.testPerIOCounterAggregation(TestTezJobs.java:345)
FAILED: org.apache.tez.test.TestTezJobs.testSortMergeJoinExample
Error Message:
expected:<0> but was:<-1>
Stack Trace:
java.lang.AssertionError: expected:<0> but was:<-1>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at
org.apache.tez.test.TestTezJobs.testSortMergeJoinExample(TestTezJobs.java:304)
