Jira: https://issues.apache.org/jira/browse/TEZ-3617
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2466/
###################################################################################
########################## LAST 60 LINES OF THE CONSOLE
###########################
[...truncated 334.00 KB...]
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12869290/TEZ-3617.1.patch
against master revision 1176733.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:red}-1 javac{color}. The applied patch generated 40 javac
compiler warnings (more than the master's current 32 warnings).
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 3.0.1) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in :
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestMergeManager
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter
org.apache.hadoop.mapred.split.TestGroupedSplits
org.apache.tez.mapreduce.processor.map.TestMapProcessor
Test results:
https://builds.apache.org/job/PreCommit-TEZ-Build/2466//testReport/
Javac warnings:
https://builds.apache.org/job/PreCommit-TEZ-Build/2466//artifact/patchprocess/diffJavacWarnings.txt
Console output: https://builds.apache.org/job/PreCommit-TEZ-Build/2466//console
This message is automatically generated.
======================================================================
======================================================================
Adding comment to Jira.
======================================================================
======================================================================
Comment added.
fbca845f051a1f449f47a81d42b557c86fe79b48 logged out
======================================================================
======================================================================
Finished build.
======================================================================
======================================================================
Build step 'Execute shell' marked build as failure
Archiving artifacts
Compressed 3.50 MB of artifacts by 10.7% relative to #2459
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
###################################################################################
############################## FAILED TESTS (if any)
##############################
10 tests failed.
FAILED: org.apache.hadoop.mapred.split.TestGroupedSplits.testFormat
Error Message:
We got more than one splits! expected:<1> but was:<2>
Stack Trace:
java.lang.AssertionError: We got more than one splits! expected:<1> but was:<2>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at
org.apache.hadoop.mapred.split.TestGroupedSplits.testFormat(TestGroupedSplits.java:127)
FAILED:
org.apache.tez.mapreduce.processor.map.TestMapProcessor.testMapProcessor
Error Message:
File file:/tmp/TestMapProcessor/localized-resources/job.splitmetainfo does not
exist
Stack Trace:
java.io.FileNotFoundException: File
file:/tmp/TestMapProcessor/localized-resources/job.splitmetainfo does not exist
at
org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:609)
at
org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:822)
at
org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:599)
at
org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421)
at
org.apache.hadoop.mapreduce.split.SplitMetaInfoReaderTez.readSplitMetaInfo(SplitMetaInfoReaderTez.java:77)
at
org.apache.tez.mapreduce.lib.MRInputUtils.readSplits(MRInputUtils.java:52)
at
org.apache.tez.mapreduce.input.MRInput.initializeInternal(MRInput.java:493)
at
org.apache.tez.mapreduce.input.MRInputLegacy.init(MRInputLegacy.java:113)
at
org.apache.tez.mapreduce.processor.map.MapProcessor.run(MapProcessor.java:116)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
at
org.apache.tez.mapreduce.processor.map.TestMapProcessor.testMapProcessor(TestMapProcessor.java:160)
FAILED:
org.apache.tez.mapreduce.processor.map.TestMapProcessor.testMapProcessorProgress
Error Message:
File file:/tmp/TestMapProcessor/work/data does not exist
Stack Trace:
java.io.FileNotFoundException: File file:/tmp/TestMapProcessor/work/data does
not exist
at
org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:609)
at
org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:822)
at
org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:599)
at
org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421)
at
org.apache.hadoop.mapred.SequenceFileInputFormat.listStatus(SequenceFileInputFormat.java:52)
at
org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:315)
at
org.apache.tez.mapreduce.processor.MapUtils.createInputSplit(MapUtils.java:148)
at
org.apache.tez.mapreduce.processor.MapUtils.generateInputSplit(MapUtils.java:196)
at
org.apache.tez.mapreduce.processor.map.TestMapProcessor.testMapProcessorProgress(TestMapProcessor.java:214)
FAILED:
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestMergeManager.testIntermediateMemoryMerge
Error Message:
Could not find any valid local directory for
432b774c-7223-48a4-ab5a-cf82188b1a6b_src_3_spill_2147483647.out
Stack Trace:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any valid
local directory for
432b774c-7223-48a4-ab5a-cf82188b1a6b_src_3_spill_2147483647.out
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:402)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
at
org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles.getInputFileForWrite(TezTaskOutputFiles.java:250)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MergeManager.finalMerge(MergeManager.java:1182)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MergeManager.close(MergeManager.java:653)
at
org.apache.tez.runtime.library.common.shuffle.orderedgrouped.TestMergeManager.testIntermediateMemoryMerge(TestMergeManager.java:514)
FAILED:
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testWithLargeKeyValue
Error Message:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/e21edff5-5544-448e-a991-a59a67e96906_0/file.out
Stack Trace:
java.io.FileNotFoundException:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/e21edff5-5544-448e-a991-a59a67e96906_0/file.out
at
org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:200)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:767)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$DiskSegment.init(TezMerger.java:380)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:732)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:671)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger.merge(TezMerger.java:145)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.flush(PipelinedSorter.java:760)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.closeSorter(TestPipelinedSorter.java:720)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData(TestPipelinedSorter.java:714)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData(TestPipelinedSorter.java:701)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.basicTest(TestPipelinedSorter.java:405)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testWithLargeKeyValue(TestPipelinedSorter.java:190)
FAILED:
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testExceedsKVWithMultiplePartitions
Error Message:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/18ba708e-47bf-4edf-8e49-75ddae688e08_0/file.out
Stack Trace:
java.io.FileNotFoundException:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/18ba708e-47bf-4edf-8e49-75ddae688e08_0/file.out
at
org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:200)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:767)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$DiskSegment.init(TezMerger.java:380)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:732)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:671)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger.merge(TezMerger.java:145)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.flush(PipelinedSorter.java:760)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.closeSorter(TestPipelinedSorter.java:720)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData(TestPipelinedSorter.java:714)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData(TestPipelinedSorter.java:701)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testExceedsKVWithMultiplePartitions(TestPipelinedSorter.java:216)
FAILED:
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testWithCustomComparator
Error Message:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/9cea0463-e4bb-487c-b8af-77173c5264bd_0/file.out
Stack Trace:
java.io.FileNotFoundException:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/9cea0463-e4bb-487c-b8af-77173c5264bd_0/file.out
at
org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:200)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:767)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$DiskSegment.init(TezMerger.java:380)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:732)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:671)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger.merge(TezMerger.java:145)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.flush(PipelinedSorter.java:760)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.closeSorter(TestPipelinedSorter.java:720)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData(TestPipelinedSorter.java:714)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData(TestPipelinedSorter.java:701)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.basicTest(TestPipelinedSorter.java:405)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testWithCustomComparator(TestPipelinedSorter.java:328)
FAILED:
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testExceedsKVWithPipelinedShuffle
Error Message:
File
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/6871fe1e-cd34-4415-a816-ae11f16e1eae_1/file.out
does not exist
Stack Trace:
java.io.FileNotFoundException: File
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/6871fe1e-cd34-4415-a816-ae11f16e1eae_1/file.out
does not exist
at
org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:609)
at
org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:822)
at
org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:599)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.spillSingleRecord(PipelinedSorter.java:523)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.collect(PipelinedSorter.java:419)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.collect(PipelinedSorter.java:425)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.collect(PipelinedSorter.java:425)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.write(PipelinedSorter.java:372)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData(TestPipelinedSorter.java:710)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData(TestPipelinedSorter.java:701)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testExceedsKVWithPipelinedShuffle(TestPipelinedSorter.java:231)
FAILED:
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testWithVariableKVLength1
Error Message:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/255063f9-659e-4f2a-8ada-45e75822a8ef_0/file.out
Stack Trace:
java.io.FileNotFoundException:
/tmp/org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter/output/255063f9-659e-4f2a-8ada-45e75822a8ef_0/file.out
at
org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:200)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:767)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$DiskSegment.init(TezMerger.java:380)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:732)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:671)
at
org.apache.tez.runtime.library.common.sort.impl.TezMerger.merge(TezMerger.java:145)
at
org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.flush(PipelinedSorter.java:760)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.writeData2(TestPipelinedSorter.java:392)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.basicTest2(TestPipelinedSorter.java:375)
at
org.apache.tez.runtime.library.common.sort.impl.TestPipelinedSorter.testWithVariableKVLength1(TestPipelinedSorter.java:298)
FAILED:
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testMergeBuffersAndSpill[test[true,
PRECISE]]
Error Message:
Task com.google.common.util.concurrent.ListenableFutureTask@79af126e rejected
from java.util.concurrent.ThreadPoolExecutor@54e3322b[Running, pool size = 2,
active threads = 2, queued tasks = 0, completed tasks = 1]
Stack Trace:
java.util.concurrent.RejectedExecutionException: Task
com.google.common.util.concurrent.ListenableFutureTask@79af126e rejected from
java.util.concurrent.ThreadPoolExecutor@54e3322b[Running, pool size = 2, active
threads = 2, queued tasks = 0, completed tasks = 1]
at
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
at
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
at
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
at
com.google.common.util.concurrent.MoreExecutors$ListeningDecorator.execute(MoreExecutors.java:440)
at
com.google.common.util.concurrent.AbstractListeningExecutorService.submit(AbstractListeningExecutorService.java:56)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.setupNextBuffer(UnorderedPartitionedKVWriter.java:436)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.write(UnorderedPartitionedKVWriter.java:378)
at
org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter.write(UnorderedPartitionedKVWriter.java:329)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.baseTest(TestUnorderedPartitionedKVWriter.java:819)
at
org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testMergeBuffersAndSpill(TestUnorderedPartitionedKVWriter.java:259)
