Jira: https://issues.apache.org/jira/browse/TEZ-3691
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2467/
###################################################################################
########################## LAST 60 LINES OF THE CONSOLE
###########################
[...truncated 108.01 KB...]
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12869274/TEZ-3691.08.patch
against master revision 1176733.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:red}-1 javac{color}. The applied patch generated 40 javac
compiler warnings (more than the master's current 32 warnings).
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 3.0.1) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in :
org.apache.tez.runtime.library.common.sort.impl.TestTezMerger
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestMergeManager
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter
org.apache.hadoop.mapred.split.TestGroupedSplits
org.apache.tez.mapreduce.processor.map.TestMapProcessor
org.apache.tez.mapreduce.processor.reduce.TestReduceProcessor
org.apache.tez.dag.app.TestDAGAppMaster
org.apache.tez.dag.app.TestSpeculation
Test results:
https://builds.apache.org/job/PreCommit-TEZ-Build/2467//testReport/
Javac warnings:
https://builds.apache.org/job/PreCommit-TEZ-Build/2467//artifact/patchprocess/diffJavacWarnings.txt
Console output: https://builds.apache.org/job/PreCommit-TEZ-Build/2467//console
This message is automatically generated.
======================================================================
======================================================================
Adding comment to Jira.
======================================================================
======================================================================
Comment added.
69549796ae673b4f4f97f86b9807cd36ce049219 logged out
======================================================================
======================================================================
Finished build.
======================================================================
======================================================================
Build step 'Execute shell' marked build as failure
Archiving artifacts
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
###################################################################################
############################## FAILED TESTS (if any)
##############################
17 tests failed.
FAILED: org.apache.tez.dag.app.TestDAGAppMaster.testInvalidSession
Error Message:
java.io.FileNotFoundException:
/tmp/TestDAGAppMaster/tez.session.local-resources.pb (No such file or directory)
Stack Trace:
org.apache.hadoop.service.ServiceStateException: java.io.FileNotFoundException:
/tmp/TestDAGAppMaster/tez.session.local-resources.pb (No such file or directory)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:221)
at java.io.FileOutputStream.<init>(FileOutputStream.java:171)
at
org.apache.tez.dag.app.TestDAGAppMaster$DAGAppMasterForTest.stubSessionResources(TestDAGAppMaster.java:564)
at
org.apache.tez.dag.app.TestDAGAppMaster$DAGAppMasterForTest.serviceInit(TestDAGAppMaster.java:573)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.tez.dag.app.TestDAGAppMaster.testInvalidSession(TestDAGAppMaster.java:115)
FAILED:
org.apache.tez.dag.app.TestSpeculation.testBasicSpeculationWithoutProgress
Error Message:
expected:<SUCCEEDED> but was:<ERROR>
Stack Trace:
java.lang.AssertionError: expected:<SUCCEEDED> but was:<ERROR>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at
org.apache.tez.dag.app.TestSpeculation.testBasicSpeculation(TestSpeculation.java:121)
at
org.apache.tez.dag.app.TestSpeculation.testBasicSpeculationWithoutProgress(TestSpeculation.java:149)
FAILED: org.apache.hadoop.mapred.split.TestGroupedSplits.testGzip
Error Message:
splits length expected:<11> but was:<1035>
Stack Trace:
java.lang.AssertionError: splits length expected:<11> but was:<1035>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at
org.apache.hadoop.mapred.split.TestGroupedSplits.testGzip(TestGroupedSplits.java:276)
FAILED:
org.apache.tez.mapreduce.processor.reduce.TestReduceProcessor.testReduceProcessor
Error Message:
No space available in any of the local directories.
Stack Trace:
org.apache.hadoop.util.DiskChecker$DiskErrorException: No space available in
any of the local directories.
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:366)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:115)
at
org.apache.tez.mapreduce.processor.MRTask.configureLocalDirs(MRTask.java:236)
at
org.apache.tez.mapreduce.processor.MRTask.configureMRTask(MRTask.java:210)
at org.apache.tez.mapreduce.processor.MRTask.initialize(MRTask.java:184)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.initializeLogicalIOProcessor(LogicalIOProcessorRuntimeTask.java:587)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.initialize(LogicalIOProcessorRuntimeTask.java:258)
at
org.apache.tez.mapreduce.processor.reduce.TestReduceProcessor.testReduceProcessor(TestReduceProcessor.java:234)
FAILED:
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestMergeManager.testOnDiskMergerFilenames
Error Message:
chmod: cannot access '/tmp/TestMergeManager/srcData/attemptsrc3.out': No such
file or directory
Stack Trace:
org.apache.hadoop.util.Shell$ExitCodeException: chmod: cannot access
'/tmp/TestMergeManager/srcData/attemptsrc3.out': No such file or directory
at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
at org.apache.hadoop.util.Shell.run(Shell.java:456)
at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:815)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:798)
at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:731)
at
org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:225)
at
org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:209)
at
org.apache.hadoop.fs.RawLocalFileSystem.createOutputStreamWithMode(RawLocalFileSystem.java:305)
at
org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:294)
at
org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:326)
at
org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.<init>(ChecksumFileSystem.java:393)
at
org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:456)
at
org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:435)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:909)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:890)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:787)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:776)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestMergeManager.createFile(TestMergeManager.java:929)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestMergeManager.testOnDiskMergerFilenames(TestMergeManager.java:701)
FAILED:
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.test_with_lazyMemAllocation
Error Message:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/ce2913e8-b1bb-496a-a1bb-f461881368f8_1/file.out
Stack Trace:
java.io.FileNotFoundException:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/ce2913e8-b1bb-496a-a1bb-f461881368f8_1/file.out
at
org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:200)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:767)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$DiskSegment.init(TezMerger.java:380)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:732)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:671)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger.merge(TezMerger.java:145)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.flush(PipelinedSorter.java:760)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.closeSorter(TestPipelinedSorter.java:720)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.test_with_lazyMemAllocation(TestPipelinedSorter.java:645)
FAILED:
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.test_TEZ_2602_50mb
Error Message:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/b34a769f-15be-47c5-923a-7149e123f1fb_0/file.out
Stack Trace:
java.io.FileNotFoundException:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/b34a769f-15be-47c5-923a-7149e123f1fb_0/file.out
at
org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:200)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:767)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$DiskSegment.init(TezMerger.java:380)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:732)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:671)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger.merge(TezMerger.java:145)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.flush(PipelinedSorter.java:760)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.test_TEZ_2602_50mb(TestPipelinedSorter.java:259)
FAILED: org.apache.tez.runtime.library.common.sort.impl.TestTezMerger.testMerge
Error Message:
File
file:/tmp/org.apache.tez.runtime.library.common.sort.impl.TestTezMerger/src/data_7776208265936994.out
does not exist
Stack Trace:
java.io.FileNotFoundException: File
file:/tmp/org.apache.tez.runtime.library.common.sort.impl.TestTezMerger/src/data_7776208265936994.out
does not exist
at
org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:609)
at
org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:822)
at
org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:599)
at
org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$DiskSegment.<init>(TezMerger.java:345)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.<init>(TezMerger.java:491)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger.merge(TezMerger.java:84)
at
org.apache.tez.runtime.library.common.sort.impl.TestTezMerger.merge(TestTezMerger.java:605)
at
org.apache.tez.runtime.library.common.sort.impl.TestTezMerger.merge(TestTezMerger.java:599)
at
org.apache.tez.runtime.library.common.sort.impl.TestTezMerger.testMerge(TestTezMerger.java:124)
FAILED:
org.apache.tez.runtime.library.common.sort.impl.TestTezMerger.testMergeSegments
Error Message:
Could not find any valid local directory for
file:/tmp/org.apache.tez.runtime.library.common.sort.impl.TestTezMerger/tmp_7776209071014395/intermediate.1
Stack Trace:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any valid
local directory for
file:/tmp/org.apache.tez.runtime.library.common.sort.impl.TestTezMerger/tmp_7776209071014395/intermediate.1
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:402)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:820)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:671)
at
org.apache.tez.runtime.library.common.sort.impl.TestTezMerger.mergeSegments(TestTezMerger.java:704)
at
org.apache.tez.runtime.library.common.sort.impl.TestTezMerger.testMergeSegments(TestTezMerger.java:682)
FAILED:
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testMergeBuffersAndSpill[test[true,
ENABLED]]
Error Message:
Task com.google.common.util.concurrent.ListenableFutureTask@309c3c24 rejected
from java.util.concurrent.ThreadPoolExecutor@6130786a[Running, pool size = 2,
active threads = 2, queued tasks = 0, completed tasks = 1]
Stack Trace:
java.util.concurrent.RejectedExecutionException: Task
com.google.common.util.concurrent.ListenableFutureTask@309c3c24 rejected from
java.util.concurrent.ThreadPoolExecutor@6130786a[Running, pool size = 2, active
threads = 2, queued tasks = 0, completed tasks = 1]
at
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
at
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
at
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
at
com.google.common.util.concurrent.MoreExecutors$ListeningDecorator.execute(MoreExecutors.java:440)
at
com.google.common.util.concurrent.AbstractListeningExecutorService.submit(AbstractListeningExecutorService.java:56)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.setupNextBuffer(UnorderedPartitionedKVWriter.java:436)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.write(UnorderedPartitionedKVWriter.java:378)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.write(UnorderedPartitionedKVWriter.java:329)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.baseTest(TestUnorderedPartitionedKVWriter.java:819)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testMergeBuffersAndSpill(TestUnorderedPartitionedKVWriter.java:259)
FAILED:
org.apache.tez.mapreduce.processor.map.TestMapProcessor.testMapProcessor
Error Message:
File file:/tmp/TestMapProcessor/localized-resources/data does not exist
Stack Trace:
java.io.FileNotFoundException: File
file:/tmp/TestMapProcessor/localized-resources/data does not exist
at
org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:609)
at
org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:822)
at
org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:599)
at
org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421)
at
org.apache.hadoop.mapred.SequenceFileInputFormat.listStatus(SequenceFileInputFormat.java:52)
at
org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:315)
at
org.apache.tez.mapreduce.processor.MapUtils.createInputSplit(MapUtils.java:148)
at
org.apache.tez.mapreduce.processor.MapUtils.generateInputSplit(MapUtils.java:196)
at
org.apache.tez.mapreduce.processor.map.TestMapProcessor.testMapProcessor(TestMapProcessor.java:140)
FAILED:
org.apache.tez.mapreduce.processor.map.TestMapProcessor.testMapProcessorProgress
Error Message:
Could not find any valid local directory for
output/attempt_0_0000_0_00_000000_0_10003_0/file.out
Stack Trace:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any valid
local directory for output/attempt_0_0000_0_00_000000_0_10003_0/file.out
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:402)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
at
org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles.getSpillFileForWrite(TezTaskOutputFiles.java:207)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.spill(PipelinedSorter.java:555)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.flush(PipelinedSorter.java:653)
at
org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput.close(OrderedPartitionedKVOutput.java:186)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.close(LogicalIOProcessorRuntimeTask.java:397)
at
org.apache.tez.mapreduce.processor.map.TestMapProcessor.testMapProcessorProgress(TestMapProcessor.java:251)
FAILED:
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestMergeManager.testIntermediateMemoryMerge
Error Message:
Could not find any valid local directory for
75b75fcd-71ed-4865-8ba1-27df638165f0_src_0_spill_2147483647.out
Stack Trace:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any valid
local directory for
75b75fcd-71ed-4865-8ba1-27df638165f0_src_0_spill_2147483647.out
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:402)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
at
org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles.getInputFileForWrite(TezTaskOutputFiles.java:250)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MergeManager.finalMerge(MergeManager.java:1182)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MergeManager.close(MergeManager.java:653)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestMergeManager.testIntermediateMemoryMerge(TestMergeManager.java:339)
FAILED:
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testWithLargeKeyValue
Error Message:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/576547a5-0eb1-43f2-89fb-8469ac081f58_0/file.out
Stack Trace:
java.io.FileNotFoundException:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/576547a5-0eb1-43f2-89fb-8469ac081f58_0/file.out
at
org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:200)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:767)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$DiskSegment.init(TezMerger.java:380)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:732)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:671)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger.merge(TezMerger.java:145)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.flush(PipelinedSorter.java:760)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.closeSorter(TestPipelinedSorter.java:720)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData(TestPipelinedSorter.java:714)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData(TestPipelinedSorter.java:701)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.basicTest(TestPipelinedSorter.java:405)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testWithLargeKeyValue(TestPipelinedSorter.java:190)
FAILED:
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testExceedsKVWithMultiplePartitions
Error Message:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/4e887217-ee0f-4e55-b016-f937ba8b9146_0/file.out
Stack Trace:
java.io.FileNotFoundException:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/4e887217-ee0f-4e55-b016-f937ba8b9146_0/file.out
at
org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:200)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:767)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$DiskSegment.init(TezMerger.java:380)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:732)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:671)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger.merge(TezMerger.java:145)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.flush(PipelinedSorter.java:760)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.closeSorter(TestPipelinedSorter.java:720)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData(TestPipelinedSorter.java:714)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData(TestPipelinedSorter.java:701)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testExceedsKVWithMultiplePartitions(TestPipelinedSorter.java:216)
FAILED:
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testWithCustomComparator
Error Message:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/f6bdd782-f6c6-4198-be5c-8769f5040cb4_0/file.out
Stack Trace:
java.io.FileNotFoundException:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/f6bdd782-f6c6-4198-be5c-8769f5040cb4_0/file.out
at
org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:200)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:767)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$DiskSegment.init(TezMerger.java:380)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:732)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:671)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger.merge(TezMerger.java:145)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.flush(PipelinedSorter.java:760)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.closeSorter(TestPipelinedSorter.java:720)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData(TestPipelinedSorter.java:714)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData(TestPipelinedSorter.java:701)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.basicTest(TestPipelinedSorter.java:405)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testWithCustomComparator(TestPipelinedSorter.java:328)
FAILED:
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testWithVariableKVLength1
Error Message:
No space available in any of the local directories.
Stack Trace:
org.apache.hadoop.util.DiskChecker$DiskErrorException: No space available in
any of the local directories.
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:366)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
at
org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles.getSpillFileForWrite(TezTaskOutputFiles.java:207)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.spillSingleRecord(PipelinedSorter.java:472)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.collect(PipelinedSorter.java:419)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.collect(PipelinedSorter.java:425)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.collect(PipelinedSorter.java:425)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.write(PipelinedSorter.java:372)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData2(TestPipelinedSorter.java:388)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.basicTest2(TestPipelinedSorter.java:375)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testWithVariableKVLength1(TestPipelinedSorter.java:298)