Jira: https://issues.apache.org/jira/browse/TEZ-3303
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1825/
###################################################################################
########################## LAST 60 LINES OF THE CONSOLE
###########################
[...truncated 1473 lines...]
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12815836/TEZ-3303.002.patch
against master revision d7b6eb5.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:red}-1 javadoc{color}. The javadoc tool appears to have generated 1
warning messages.
See
https://builds.apache.org/job/PreCommit-TEZ-Build/1825//artifact/patchprocess/diffJavadocWarnings.txt
for details.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 3.0.1) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in :
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter
org.apache.tez.dag.history.ats.acls.TestATSHistoryWithACLs
org.apache.tez.dag.history.logging.ats.TestATSHistoryWithMiniCluster
Test results:
https://builds.apache.org/job/PreCommit-TEZ-Build/1825//testReport/
Console output: https://builds.apache.org/job/PreCommit-TEZ-Build/1825//console
This message is automatically generated.
======================================================================
======================================================================
Adding comment to Jira.
======================================================================
======================================================================
Comment added.
b6220422c9e1ea38d8794d202cc36519cdc046f8 logged out
======================================================================
======================================================================
Finished build.
======================================================================
======================================================================
Build step 'Execute shell' marked build as failure
Archiving artifacts
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
###################################################################################
############################## FAILED TESTS (if any)
##############################
24 tests failed.
FAILED:
org.apache.tez.dag.history.ats.acls.TestATSHistoryWithACLs.testDisableSessionLogging
Error Message:
test timed out after 50000 milliseconds
Stack Trace:
java.lang.Exception: test timed out after 50000 milliseconds
at java.lang.Thread.sleep(Native Method)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:151)
at com.sun.proxy.$Proxy89.getNewApplication(Unknown Source)
at
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getNewApplication(YarnClientImpl.java:206)
at
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.createApplication(YarnClientImpl.java:214)
at
org.apache.tez.client.TezYarnClient.createApplication(TezYarnClient.java:66)
at
org.apache.tez.client.TezClient.createApplication(TezClient.java:1046)
at org.apache.tez.client.TezClient.start(TezClient.java:455)
at
org.apache.tez.dag.history.ats.acls.TestATSHistoryWithACLs.testDisableSessionLogging(TestATSHistoryWithACLs.java:511)
FAILED:
org.apache.tez.dag.history.ats.acls.TestATSHistoryWithACLs.testMultipleDagSession
Error Message:
test timed out after 50000 milliseconds
Stack Trace:
java.lang.Exception: test timed out after 50000 milliseconds
at java.lang.Thread.sleep(Native Method)
at
org.apache.hadoop.ipc.Client$Connection.handleConnectionFailure(Client.java:853)
at
org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:626)
at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:705)
at org.apache.hadoop.ipc.Client$Connection.access$2800(Client.java:368)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1521)
at org.apache.hadoop.ipc.Client.call(Client.java:1438)
at org.apache.hadoop.ipc.Client.call(Client.java:1399)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy88.getNewApplication(Unknown Source)
at
org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getNewApplication(ApplicationClientProtocolPBClientImpl.java:217)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy89.getNewApplication(Unknown Source)
at
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getNewApplication(YarnClientImpl.java:206)
at
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.createApplication(YarnClientImpl.java:214)
at
org.apache.tez.client.TezYarnClient.createApplication(TezYarnClient.java:66)
at
org.apache.tez.client.TezClient.createApplication(TezClient.java:1046)
at org.apache.tez.client.TezClient.start(TezClient.java:455)
at
org.apache.tez.dag.history.ats.acls.TestATSHistoryWithACLs.testMultipleDagSession(TestATSHistoryWithACLs.java:340)
FAILED:
org.apache.tez.dag.history.ats.acls.TestATSHistoryWithACLs.testDagLoggingEnabled
Error Message:
java.net.ConnectException: Connection refused
Stack Trace:
com.sun.jersey.api.client.ClientHandlerException: java.net.ConnectException:
Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:579)
at java.net.Socket.connect(Socket.java:528)
at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
at sun.net.www.http.HttpClient.<init>(HttpClient.java:211)
at sun.net.www.http.HttpClient.New(HttpClient.java:308)
at sun.net.www.http.HttpClient.New(HttpClient.java:326)
at
sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:996)
at
sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:932)
at
sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:850)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1300)
at
java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:468)
at
com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:240)
at
com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:147)
at com.sun.jersey.api.client.Client.handle(Client.java:648)
at com.sun.jersey.api.client.WebResource.handle(WebResource.java:670)
at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74)
at
com.sun.jersey.api.client.WebResource$Builder.get(WebResource.java:503)
at
org.apache.tez.dag.history.ats.acls.TestATSHistoryWithACLs.testDagLoggingEnabled(TestATSHistoryWithACLs.java:631)
FAILED:
org.apache.tez.dag.history.ats.acls.TestATSHistoryWithACLs.testSimpleAMACls
Error Message:
test timed out after 50000 milliseconds
Stack Trace:
java.lang.Exception: test timed out after 50000 milliseconds
at java.lang.Thread.sleep(Native Method)
at
org.apache.hadoop.ipc.Client$Connection.handleConnectionFailure(Client.java:853)
at
org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:626)
at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:705)
at org.apache.hadoop.ipc.Client$Connection.access$2800(Client.java:368)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1521)
at org.apache.hadoop.ipc.Client.call(Client.java:1438)
at org.apache.hadoop.ipc.Client.call(Client.java:1399)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy88.getNewApplication(Unknown Source)
at
org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getNewApplication(ApplicationClientProtocolPBClientImpl.java:217)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy89.getNewApplication(Unknown Source)
at
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getNewApplication(YarnClientImpl.java:206)
at
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.createApplication(YarnClientImpl.java:214)
at
org.apache.tez.client.TezYarnClient.createApplication(TezYarnClient.java:66)
at
org.apache.tez.client.TezClient.createApplication(TezClient.java:1046)
at org.apache.tez.client.TezClient.start(TezClient.java:455)
at
org.apache.tez.dag.history.ats.acls.TestATSHistoryWithACLs.testSimpleAMACls(TestATSHistoryWithACLs.java:219)
FAILED: org.apache.tez.dag.history.ats.acls.TestATSHistoryWithACLs.testDAGACls
Error Message:
test timed out after 50000 milliseconds
Stack Trace:
java.lang.Exception: test timed out after 50000 milliseconds
at java.lang.Thread.sleep(Native Method)
at
org.apache.hadoop.ipc.Client$Connection.handleConnectionFailure(Client.java:853)
at
org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:626)
at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:705)
at org.apache.hadoop.ipc.Client$Connection.access$2800(Client.java:368)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1521)
at org.apache.hadoop.ipc.Client.call(Client.java:1438)
at org.apache.hadoop.ipc.Client.call(Client.java:1399)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy88.getNewApplication(Unknown Source)
at
org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getNewApplication(ApplicationClientProtocolPBClientImpl.java:217)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy89.getNewApplication(Unknown Source)
at
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getNewApplication(YarnClientImpl.java:206)
at
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.createApplication(YarnClientImpl.java:214)
at
org.apache.tez.client.TezYarnClient.createApplication(TezYarnClient.java:66)
at
org.apache.tez.client.TezClient.createApplication(TezClient.java:1046)
at org.apache.tez.client.TezClient.start(TezClient.java:455)
at
org.apache.tez.dag.history.ats.acls.TestATSHistoryWithACLs.testDAGACls(TestATSHistoryWithACLs.java:275)
FAILED:
org.apache.tez.dag.history.ats.acls.TestATSHistoryWithACLs.testMultipleDagNonSession
Error Message:
test timed out after 50000 milliseconds
Stack Trace:
java.lang.Exception: test timed out after 50000 milliseconds
at java.lang.Thread.sleep(Native Method)
at
org.apache.hadoop.ipc.Client$Connection.handleConnectionFailure(Client.java:853)
at
org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:626)
at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:705)
at org.apache.hadoop.ipc.Client$Connection.access$2800(Client.java:368)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1521)
at org.apache.hadoop.ipc.Client.call(Client.java:1438)
at org.apache.hadoop.ipc.Client.call(Client.java:1399)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy88.getNewApplication(Unknown Source)
at
org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getNewApplication(ApplicationClientProtocolPBClientImpl.java:217)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy89.getNewApplication(Unknown Source)
at
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getNewApplication(YarnClientImpl.java:206)
at
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.createApplication(YarnClientImpl.java:214)
at
org.apache.tez.client.TezYarnClient.createApplication(TezYarnClient.java:66)
at
org.apache.tez.client.TezClient.createApplication(TezClient.java:1046)
at
org.apache.tez.client.TezClient.submitDAGApplication(TezClient.java:994)
at org.apache.tez.client.TezClient.submitDAG(TezClient.java:506)
at
org.apache.tez.dag.history.ats.acls.TestATSHistoryWithACLs.testMultipleDagNonSession(TestATSHistoryWithACLs.java:432)
FAILED:
org.apache.tez.dag.history.logging.ats.TestATSHistoryWithMiniCluster.testDisabledACls
Error Message:
test timed out after 50000 milliseconds
Stack Trace:
java.lang.Exception: test timed out after 50000 milliseconds
at java.lang.Thread.sleep(Native Method)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:151)
at com.sun.proxy.$Proxy89.getNewApplication(Unknown Source)
at
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getNewApplication(YarnClientImpl.java:206)
at
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.createApplication(YarnClientImpl.java:214)
at
org.apache.tez.client.TezYarnClient.createApplication(TezYarnClient.java:66)
at
org.apache.tez.client.TezClient.createApplication(TezClient.java:1046)
at org.apache.tez.client.TezClient.start(TezClient.java:455)
at
org.apache.tez.dag.history.logging.ats.TestATSHistoryWithMiniCluster.testDisabledACls(TestATSHistoryWithMiniCluster.java:155)
FAILED:
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testKVExceedsBuffer
Error Message:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/8c8e9834-242b-4445-bba5-39dfd648d1e4_0/file.out
Stack Trace:
java.io.FileNotFoundException:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/8c8e9834-242b-4445-bba5-39dfd648d1e4_0/file.out
at
org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:198)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:766)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$DiskSegment.init(TezMerger.java:405)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:753)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:694)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger.merge(TezMerger.java:170)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.flush(PipelinedSorter.java:750)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.closeSorter(TestPipelinedSorter.java:720)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData(TestPipelinedSorter.java:714)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData(TestPipelinedSorter.java:701)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.basicTest(TestPipelinedSorter.java:405)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testKVExceedsBuffer(TestPipelinedSorter.java:196)
FAILED:
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testWithLargeKeyValue
Error Message:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/b82d9a2c-de24-4dae-9be0-4e69104a3080_0/file.out
Stack Trace:
java.io.FileNotFoundException:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/b82d9a2c-de24-4dae-9be0-4e69104a3080_0/file.out
at
org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:198)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:766)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$DiskSegment.init(TezMerger.java:405)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:753)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:694)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger.merge(TezMerger.java:170)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.flush(PipelinedSorter.java:750)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.closeSorter(TestPipelinedSorter.java:720)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData(TestPipelinedSorter.java:714)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData(TestPipelinedSorter.java:701)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.basicTest(TestPipelinedSorter.java:405)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testWithLargeKeyValue(TestPipelinedSorter.java:190)
FAILED:
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.test_with_lazyMemAllocation
Error Message:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/52c5a583-1662-496f-9a3c-8b7a3d558952_0/file.out
Stack Trace:
java.io.FileNotFoundException:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/52c5a583-1662-496f-9a3c-8b7a3d558952_0/file.out
at
org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:198)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:766)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$DiskSegment.init(TezMerger.java:405)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:753)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:694)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger.merge(TezMerger.java:170)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.flush(PipelinedSorter.java:750)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.closeSorter(TestPipelinedSorter.java:720)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.test_with_lazyMemAllocation(TestPipelinedSorter.java:611)
FAILED:
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testWithVariableKVLength1
Error Message:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/48a0c9de-bf54-4a6c-92ee-17389cbf83bd_0/file.out
Stack Trace:
java.io.FileNotFoundException:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/48a0c9de-bf54-4a6c-92ee-17389cbf83bd_0/file.out
at
org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:198)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:766)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$DiskSegment.init(TezMerger.java:405)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:753)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:694)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger.merge(TezMerger.java:170)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.flush(PipelinedSorter.java:750)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData2(TestPipelinedSorter.java:392)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.basicTest2(TestPipelinedSorter.java:375)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testWithVariableKVLength1(TestPipelinedSorter.java:298)
FAILED:
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testSingleSpill_WithPipelinedShuffle[test[false,
DISABLED, {2}]]
Error Message:
Could not find any valid local directory for
output/4c901f3f-1132-48d7-89f0-49fd2ab3ad8e_1/file.out
Stack Trace:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any valid
local directory for output/4c901f3f-1132-48d7-89f0-49fd2ab3ad8e_1/file.out
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:402)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
at
org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles.getSpillFileForWrite(TezTaskOutputFiles.java:207)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.getSpillPathDetails(UnorderedPartitionedKVWriter.java:718)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.finalSpill(UnorderedPartitionedKVWriter.java:674)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.close(UnorderedPartitionedKVWriter.java:569)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.baseTestWithPipelinedTransfer(TestUnorderedPartitionedKVWriter.java:572)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testSingleSpill_WithPipelinedShuffle(TestUnorderedPartitionedKVWriter.java:495)
FAILED:
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testSkippedPartitions_WithPipelinedShuffle[test[false,
DISABLED, {2}]]
Error Message:
Could not find any valid local directory for
output/ad671b5a-6d81-4f34-acf0-9b7ebdd9b743_2/file.out
Stack Trace:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any valid
local directory for output/ad671b5a-6d81-4f34-acf0-9b7ebdd9b743_2/file.out
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:402)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
at
org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles.getSpillFileForWrite(TezTaskOutputFiles.java:207)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.getSpillPathDetails(UnorderedPartitionedKVWriter.java:718)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.setupNextBuffer(UnorderedPartitionedKVWriter.java:361)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.write(UnorderedPartitionedKVWriter.java:323)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.write(UnorderedPartitionedKVWriter.java:274)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.baseTestWithPipelinedTransfer(TestUnorderedPartitionedKVWriter.java:564)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testSkippedPartitions_WithPipelinedShuffle(TestUnorderedPartitionedKVWriter.java:510)
FAILED:
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testLargeKvPairs[test[false,
DISABLED, {2}]]
Error Message:
/tmp/TestUnorderedPartitionedKVWriter/outDir_3303c9b4-a93d-452c-8927-5ee2155a6ff0/output/3303c9b4-a93d-452c-8927-5ee2155a6ff0_0/file.out
Stack Trace:
java.io.FileNotFoundException:
/tmp/TestUnorderedPartitionedKVWriter/outDir_3303c9b4-a93d-452c-8927-5ee2155a6ff0/output/3303c9b4-a93d-452c-8927-5ee2155a6ff0_0/file.out
at
org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:198)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:766)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.mergeAll(UnorderedPartitionedKVWriter.java:774)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.close(UnorderedPartitionedKVWriter.java:558)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.textTest(TestUnorderedPartitionedKVWriter.java:350)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testLargeKvPairs(TestUnorderedPartitionedKVWriter.java:244)
FAILED:
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testSkippedPartitions[test[false,
DISABLED, {2}]]
Error Message:
Could not find any valid local directory for
output/35ad7348-c98b-4426-b262-7a8493f6d425_1/file.out
Stack Trace:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any valid
local directory for output/35ad7348-c98b-4426-b262-7a8493f6d425_1/file.out
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:402)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
at
org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles.getSpillFileForWrite(TezTaskOutputFiles.java:207)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.getSpillPathDetails(UnorderedPartitionedKVWriter.java:715)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.setupNextBuffer(UnorderedPartitionedKVWriter.java:361)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.write(UnorderedPartitionedKVWriter.java:323)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.write(UnorderedPartitionedKVWriter.java:274)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.baseTest(TestUnorderedPartitionedKVWriter.java:749)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testSkippedPartitions(TestUnorderedPartitionedKVWriter.java:218)
FAILED:
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testLargevalues[test[false,
DISABLED, {2}]]
Error Message:
/tmp/TestUnorderedPartitionedKVWriter/outDir_67dd8b98-14a1-4ad5-9477-9f24b5c72e5e/output/67dd8b98-14a1-4ad5-9477-9f24b5c72e5e_5/file.out
Stack Trace:
java.io.FileNotFoundException:
/tmp/TestUnorderedPartitionedKVWriter/outDir_67dd8b98-14a1-4ad5-9477-9f24b5c72e5e/output/67dd8b98-14a1-4ad5-9477-9f24b5c72e5e_5/file.out
at
org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:198)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:766)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.mergeAll(UnorderedPartitionedKVWriter.java:774)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.close(UnorderedPartitionedKVWriter.java:558)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.textTest(TestUnorderedPartitionedKVWriter.java:350)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testLargevalues(TestUnorderedPartitionedKVWriter.java:239)
FAILED:
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testRandomText[test[false,
DISABLED, {2}]]
Error Message:
/tmp/TestUnorderedPartitionedKVWriter/outDir_a90de478-7065-4ef3-8345-eb3587778dc3/output/a90de478-7065-4ef3-8345-eb3587778dc3_0/file.out
Stack Trace:
java.io.FileNotFoundException:
/tmp/TestUnorderedPartitionedKVWriter/outDir_a90de478-7065-4ef3-8345-eb3587778dc3/output/a90de478-7065-4ef3-8345-eb3587778dc3_0/file.out
at
org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:198)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:766)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.mergeAll(UnorderedPartitionedKVWriter.java:774)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.close(UnorderedPartitionedKVWriter.java:558)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.textTest(TestUnorderedPartitionedKVWriter.java:350)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testRandomText(TestUnorderedPartitionedKVWriter.java:229)
FAILED:
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testMultipleSpills[test[false,
DISABLED, {2}]]
Error Message:
Could not find any valid local directory for
output/319be3c0-4d4e-4e06-bbcb-cde25bc83646_2/file.out
Stack Trace:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any valid
local directory for output/319be3c0-4d4e-4e06-bbcb-cde25bc83646_2/file.out
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:402)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
at
org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles.getSpillFileForWrite(TezTaskOutputFiles.java:207)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.getSpillPathDetails(UnorderedPartitionedKVWriter.java:715)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.setupNextBuffer(UnorderedPartitionedKVWriter.java:361)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.write(UnorderedPartitionedKVWriter.java:323)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.write(UnorderedPartitionedKVWriter.java:274)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.baseTest(TestUnorderedPartitionedKVWriter.java:749)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testMultipleSpills(TestUnorderedPartitionedKVWriter.java:208)
FAILED:
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testTextMixedRecords[test[false,
DISABLED, {2}]]
Error Message:
Could not find any valid local directory for
output/b2a654a6-58d5-422e-a846-6c697ef999d2_1/file.out
Stack Trace:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any valid
local directory for output/b2a654a6-58d5-422e-a846-6c697ef999d2_1/file.out
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:402)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
at
org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles.getSpillFileForWrite(TezTaskOutputFiles.java:207)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.getSpillPathDetails(UnorderedPartitionedKVWriter.java:715)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.setupNextBuffer(UnorderedPartitionedKVWriter.java:361)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.write(UnorderedPartitionedKVWriter.java:304)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.write(UnorderedPartitionedKVWriter.java:274)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.textTest(TestUnorderedPartitionedKVWriter.java:297)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testTextMixedRecords(TestUnorderedPartitionedKVWriter.java:249)
FAILED:
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testLargeKvPairs_WithPipelinedShuffle[test[false,
DISABLED, {2}]]
Error Message:
Could not find any valid local directory for
output/d07d287a-331e-4b37-bbd4-d018ac90fb57_29/file.out
Stack Trace:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any valid
local directory for output/d07d287a-331e-4b37-bbd4-d018ac90fb57_29/file.out
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:402)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
at
org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles.getSpillFileForWrite(TezTaskOutputFiles.java:207)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.getSpillPathDetails(UnorderedPartitionedKVWriter.java:718)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.writeLargeRecord(UnorderedPartitionedKVWriter.java:816)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.write(UnorderedPartitionedKVWriter.java:319)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.write(UnorderedPartitionedKVWriter.java:274)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.textTest(TestUnorderedPartitionedKVWriter.java:326)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testLargeKvPairs_WithPipelinedShuffle(TestUnorderedPartitionedKVWriter.java:515)
FAILED:
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testLargeKeys[test[false,
DISABLED, {2}]]
Error Message:
File
/tmp/TestUnorderedPartitionedKVWriter/outDir_85c70d57-b523-48ab-9c56-939e7df71b6b/output/85c70d57-b523-48ab-9c56-939e7df71b6b/file.out
does not exist
Stack Trace:
java.io.FileNotFoundException: File
/tmp/TestUnorderedPartitionedKVWriter/outDir_85c70d57-b523-48ab-9c56-939e7df71b6b/output/85c70d57-b523-48ab-9c56-939e7df71b6b/file.out
does not exist
at
org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:534)
at
org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:747)
at
org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:524)
at
org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:409)
at
org.apache.hadoop.fs.FileSystem.getContentSummary(FileSystem.java:1443)
at
org.apache.hadoop.fs.ChecksumFileSystem$FSDataBoundedInputStream.getFileLength(ChecksumFileSystem.java:279)
at
org.apache.hadoop.fs.ChecksumFileSystem$FSDataBoundedInputStream.seek(ChecksumFileSystem.java:322)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.textTest(TestUnorderedPartitionedKVWriter.java:414)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testLargeKeys(TestUnorderedPartitionedKVWriter.java:234)
FAILED:
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testNoSpill[test[false,
DISABLED, {2}]]
Error Message:
null
Stack Trace:
java.lang.AssertionError: null
at org.junit.Assert.fail(Assert.java:86)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.junit.Assert.assertTrue(Assert.java:52)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.baseTest(TestUnorderedPartitionedKVWriter.java:853)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testNoSpill(TestUnorderedPartitionedKVWriter.java:198)
FAILED:
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testSingleSpill_WithPipelinedShuffle[test[false,
ENABLED, {2}]]
Error Message:
null
Stack Trace:
java.lang.AssertionError: null
at org.junit.Assert.fail(Assert.java:86)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.junit.Assert.assertTrue(Assert.java:52)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.baseTestWithPipelinedTransfer(TestUnorderedPartitionedKVWriter.java:697)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testSingleSpill_WithPipelinedShuffle(TestUnorderedPartitionedKVWriter.java:495)
FAILED:
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testSkippedPartitions_WithPipelinedShuffle[test[false,
ENABLED, {2}]]
Error Message:
Could not find any valid local directory for
output/f0ba84b9-a8d8-402f-99fe-621cc45cce87_0/file.out
Stack Trace:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any valid
local directory for output/f0ba84b9-a8d8-402f-99fe-621cc45cce87_0/file.out
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:402)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
at
org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles.getSpillFileForWrite(TezTaskOutputFiles.java:207)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.baseTestWithPipelinedTransfer(TestUnorderedPartitionedKVWriter.java:696)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testSkippedPartitions_WithPipelinedShuffle(TestUnorderedPartitionedKVWriter.java:510)
