[jira] [Commented] (TEZ-3664) testSingleSpill_WithPipelinedShuffle[0] fails intermittently
[
https://issues.apache.org/jira/browse/TEZ-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787354#comment-16787354
]
TezQA commented on TEZ-3664:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
14s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 12 new or modified test
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
11s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
0s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 4m
1s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 3m
9s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
0s{color} | {color:blue} Skipped patched modules with no Java source:
tez-ext-service-tests . {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
21s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 4m
17s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
14s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
37s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 4m
1s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 4m
1s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
19s{color} | {color:green} The patch passed checkstyle in tez-api {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
21s{color} | {color:green} The patch passed checkstyle in tez-runtime-library
{color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
17s{color} | {color:green} The patch passed checkstyle in tez-mapreduce {color}
|
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
24s{color} | {color:green} The patch passed checkstyle in tez-dag {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
18s{color} | {color:green} tez-tests: The patch generated 0 new + 5 unchanged -
2 fixed = 5 total (was 7) {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
16s{color} | {color:green} The patch passed checkstyle in tez-ext-service-tests
{color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
15s{color} | {color:green} The patch passed checkstyle in
tez-yarn-timeline-history-with-fs {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
16s{color} | {color:green} The patch passed checkstyle in tez-aux-services
{color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
42s{color} | {color:green} root: The patch generated 0 new + 123 unchanged - 2
fixed = 123 total (was 125) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
3s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
0s{color} | {color:blue} Skipped patched modules with no Java source:
tez-ext-service-tests . {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m
14s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 4m
19s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 1m
43s{color} | {color:green} tez-api in the patch passed. {color} |
| {color:green}+1{color} |
[jira] [Commented] (TEZ-3664) testSingleSpill_WithPipelinedShuffle[0] fails intermittently
[
https://issues.apache.org/jira/browse/TEZ-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787171#comment-16787171
]
TezQA commented on TEZ-3664:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
35s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 12 new or modified test
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
39s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
53s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 7m
37s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 3m
26s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
0s{color} | {color:blue} Skipped patched modules with no Java source:
tez-ext-service-tests . {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
37s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 4m
23s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
15s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m
36s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 4m
25s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 4m
25s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
18s{color} | {color:green} The patch passed checkstyle in tez-api {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
20s{color} | {color:green} The patch passed checkstyle in tez-runtime-library
{color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
17s{color} | {color:green} The patch passed checkstyle in tez-mapreduce {color}
|
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
24s{color} | {color:green} The patch passed checkstyle in tez-dag {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
17s{color} | {color:green} tez-tests: The patch generated 0 new + 5 unchanged -
2 fixed = 5 total (was 7) {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
14s{color} | {color:green} The patch passed checkstyle in tez-ext-service-tests
{color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
15s{color} | {color:green} The patch passed checkstyle in
tez-yarn-timeline-history-with-fs {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
15s{color} | {color:green} The patch passed checkstyle in tez-aux-services
{color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
42s{color} | {color:green} root: The patch generated 0 new + 123 unchanged - 2
fixed = 123 total (was 125) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
4s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
0s{color} | {color:blue} Skipped patched modules with no Java source:
tez-ext-service-tests . {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m
25s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 4m
47s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 1m
45s{color} | {color:green} tez-api in the patch passed. {color} |
| {color:green}+1{color} |
[jira] [Updated] (TEZ-3664) testSingleSpill_WithPipelinedShuffle[0] fails intermittently
[
https://issues.apache.org/jira/browse/TEZ-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonathan Eagles updated TEZ-3664:
-
Attachment: TEZ-3664.004.patch
> testSingleSpill_WithPipelinedShuffle[0] fails intermittently
>
>
> Key: TEZ-3664
> URL: https://issues.apache.org/jira/browse/TEZ-3664
> Project: Apache Tez
> Issue Type: Bug
>Reporter: Yesha Vora
>Assignee: Jonathan Eagles
>Priority: Major
> Attachments: TEZ-3664.001.patch, TEZ-3664.002.patch,
> TEZ-3664.003.patch, TEZ-3664.004.patch
>
>
> testSingleSpill_WithPipelinedShuffle[0] unit test fails intermittently
> {code}
> Stacktrace
> java.lang.AssertionError: null
> at org.junit.Assert.fail(Assert.java:86)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at org.junit.Assert.assertTrue(Assert.java:52)
> at
> org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.baseTestWithPipelinedTransfer(TestUnorderedPartitionedKVWriter.java:503)
> at
> org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter.testSingleSpill_WithPipelinedShuffle(TestUnorderedPartitionedKVWriter.java:414)
> Standard Output
> 2017-03-20 19:50:52,538 INFO [main] writers.TestUnorderedPartitionedKVWriter
> (TestUnorderedPartitionedKVWriter.java:setup(124)) - Setup. Using test dir:
> /tmp/TestUnorderedPartitionedKVWriter
> 2017-03-20 19:50:53,065 WARN [main] util.NativeCodeLoader
> (NativeCodeLoader.java:(62)) - Unable to load native-hadoop library
> for your platform... using builtin-java classes where applicable
> 2017-03-20 19:50:53,856 INFO [Thread-5] counters.Limits
> (Limits.java:ensureInitialized(60)) - Counter limits initialized with
> parameters: GROUP_NAME_MAX=256, MAX_GROUPS=500, COUNTER_NAME_MAX=64,
> MAX_COUNTERS=1200
> 2017-03-20 19:50:53,861 INFO [Thread-5]
> writers.BaseUnorderedPartitionedKVWriter
> (BaseUnorderedPartitionedKVWriter.java:(148)) - Instantiating
> Partitioner:
> [org.apache.tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter$PartitionerForTest]
> 2017-03-20 19:50:53,870 INFO [Thread-5] writers.UnorderedPartitionedKVWriter
> (UnorderedPartitionedKVWriter.java:(221)) - destinationVertexName:
> numBuffers=2, sizePerBuffer=1024, skipBuffers=false, pipelinedShuffle=true,
> numPartitions=10
> 2017-03-20 19:50:53,871 INFO [Thread-5] writers.UnorderedPartitionedKVWriter
> (UnorderedPartitionedKVWriter.java:setupNextBuffer(333)) -
> destinationVertexName: Moving to next buffer and triggering spill
> 2017-03-20 19:50:53,913 INFO [UnorderedOutSpiller {destinationVertexName}]
> writers.UnorderedPartitionedKVWriter
> (UnorderedPartitionedKVWriter.java:callInternal(432)) -
> destinationVertexName: Finished spill 0
> 2017-03-20 19:50:53,934 INFO [Thread-5] writers.UnorderedPartitionedKVWriter
> (UnorderedPartitionedKVWriter.java:sendPipelinedEventForSpill(914)) -
> destinationVertexName: Adding spill event for spill (final update=false),
> spillId=0
> 2017-03-20 19:50:53,938 INFO [Thread-5] writers.UnorderedPartitionedKVWriter
> (UnorderedPartitionedKVWriter.java:close(473)) - destinationVertexName:
> Waiting for all spills to complete : Pending : 0
> 2017-03-20 19:50:53,938 INFO [Thread-5] writers.UnorderedPartitionedKVWriter
> (UnorderedPartitionedKVWriter.java:close(492)) - destinationVertexName: All
> spills complete
> 2017-03-20 19:50:53,948 INFO [Thread-5] writers.UnorderedPartitionedKVWriter
> (UnorderedPartitionedKVWriter.java:callInternal(432)) -
> destinationVertexName: Finished spill 1
> 2017-03-20 19:50:53,959 INFO [Thread-5] writers.UnorderedPartitionedKVWriter
> (UnorderedPartitionedKVWriter.java:sendPipelinedEventForSpill(914)) -
> destinationVertexName: Adding spill event for spill (final update=true),
> spillId=1
> 2017-03-20 19:50:53,972 INFO [main] writers.TestUnorderedPartitionedKVWriter
> (TestUnorderedPartitionedKVWriter.java:cleanup(132)) - CleanUp{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
