[jira] [Commented] (HADOOP-14735) ITestS3AEncryptionSSEC failing in parallel s3guard runs
[
https://issues.apache.org/jira/browse/HADOOP-14735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16120140#comment-16120140
]
Aaron Fabbri commented on HADOOP-14735:
---
+1 looks good to me. Thanks for doing this [~ste...@apache.org]
> ITestS3AEncryptionSSEC failing in parallel s3guard runs
> ---
>
> Key: HADOOP-14735
> URL: https://issues.apache.org/jira/browse/HADOOP-14735
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
>Affects Versions: HADOOP-13345
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Minor
> Attachments: HADOOP-14735-HADOOP-13345-001.patch
>
>
> in parallel test runs, {{ITestS3AEncryptionSSEC}} is failing (repeatedly) by
> not throwing an exception when attempting to rename one file to another using
> a different client key
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14735) ITestS3AEncryptionSSEC failing in parallel s3guard runs
[
https://issues.apache.org/jira/browse/HADOOP-14735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16115106#comment-16115106
]
Hadoop QA commented on HADOOP-14735:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 1m
46s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 2 new or modified test
files. {color} |
|| || || || {color:brown} HADOOP-13345 Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 19m
21s{color} | {color:green} HADOOP-13345 passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
26s{color} | {color:green} HADOOP-13345 passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
16s{color} | {color:green} HADOOP-13345 passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m
30s{color} | {color:green} HADOOP-13345 passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
34s{color} | {color:green} HADOOP-13345 passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
17s{color} | {color:green} HADOOP-13345 passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
20s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
20s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
20s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
13s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m
23s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
39s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
12s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
40s{color} | {color:green} hadoop-aws in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
22s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 27m 37s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Image:yetus/hadoop:14b5c93 |
| JIRA Issue | HADOOP-14735 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12880441/HADOOP-14735-HADOOP-13345-001.patch
|
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite
unit findbugs checkstyle |
| uname | Linux 4a45b0b8fdd9 3.13.0-119-generic #166-Ubuntu SMP Wed May 3
12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh
|
| git revision | HADOOP-13345 / b8ca3bd |
| Default Java | 1.8.0_131 |
| findbugs | v3.1.0-RC1 |
| Test Results |
https://builds.apache.org/job/PreCommit-HADOOP-Build/12958/testReport/ |
| modules | C: hadoop-tools/hadoop-aws U: hadoop-tools/hadoop-aws |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/12958/console |
| Powered by | Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org |
This message was automatically generated.
> ITestS3AEncryptionSSEC failing in parallel s3guard runs
> ---
>
> Key: HADOOP-14735
> URL: https://issues.apache.org/jira/browse/HADOOP-14735
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
>Affects Versions: HADOOP-13345
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Minor
> Attachments: HADOOP-14735-HADOOP-13345-001.patch
>
>
> in parallel test runs, {{ITestS3AEncryptionSSEC}} is failing (repeatedly) by
> not th
[jira] [Commented] (HADOOP-14735) ITestS3AEncryptionSSEC failing in parallel s3guard runs
[
https://issues.apache.org/jira/browse/HADOOP-14735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16114614#comment-16114614
]
Steve Loughran commented on HADOOP-14735:
-
Cause here is that this test method was using a non-absolute path for the dest
dir, so rename() would only succeed if the directory /user/stevel existed in
the test FS...the outcome depends on the previous state of the FS, and for
localdynamo that path wasn't being found.
Fix: sort out paths. I'll do this across all the tests, along with some other
cleanups.
> ITestS3AEncryptionSSEC failing in parallel s3guard runs
> ---
>
> Key: HADOOP-14735
> URL: https://issues.apache.org/jira/browse/HADOOP-14735
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
>Affects Versions: HADOOP-13345
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Minor
>
> in parallel test runs, {{ITestS3AEncryptionSSEC}} is failing (repeatedly) by
> not throwing an exception when attempting to rename one file to another using
> a different client key
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14735) ITestS3AEncryptionSSEC failing in parallel s3guard runs
[
https://issues.apache.org/jira/browse/HADOOP-14735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16114571#comment-16114571
]
Steve Loughran commented on HADOOP-14735:
-
..rename is returning false. Doesn't happen without local dynamo
{code}
T E S T S
---
Running org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEC
Tests run: 10, Failures: 1, Errors: 0, Skipped: 5, Time elapsed: 25.175 sec <<<
FAILURE! - in org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEC
testCreateFileThenMoveWithDifferentSSECKey(org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEC)
Time elapsed: 2.131 sec <<< FAILURE!
java.lang.AssertionError: Expected an exception, got false
at
org.apache.hadoop.test.LambdaTestUtils.intercept(LambdaTestUtils.java:348)
at
org.apache.hadoop.test.LambdaTestUtils.intercept(LambdaTestUtils.java:418)
at
org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEC.testCreateFileThenMoveWithDifferentSSECKey(ITestS3AEncryptionSSEC.java:135)
{code}
> ITestS3AEncryptionSSEC failing in parallel s3guard runs
> ---
>
> Key: HADOOP-14735
> URL: https://issues.apache.org/jira/browse/HADOOP-14735
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
>Affects Versions: HADOOP-13345
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Minor
>
> in parallel test runs, {{ITestS3AEncryptionSSEC}} is failing (repeatedly) by
> not throwing an exception when attempting to rename one file to another using
> a different client key
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14735) ITestS3AEncryptionSSEC failing in parallel s3guard runs
[
https://issues.apache.org/jira/browse/HADOOP-14735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16114543#comment-16114543
]
Steve Loughran commented on HADOOP-14735:
-
replace the (needless) exception throwing with a {{return getFileStatus()}}, as
{{intercept()}} will use that in its message.
{code}
testCreateFileThenMoveWithDifferentSSECKey(org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEC)
Time elapsed: 1.427 sec <<< ERROR!
java.io.FileNotFoundException: No such file or directory:
s3a://hwdev-steve-ireland-new/user/stevel/testCreateFileThenMoveWithDifferentSSECKey-different-path.txt
at
org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:1953)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:1848)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:1791)
at
org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEC.lambda$testCreateFileThenMoveWithDifferentSSECKey$2(ITestS3AEncryptionSSEC.java:146)
{code}
> ITestS3AEncryptionSSEC failing in parallel s3guard runs
> ---
>
> Key: HADOOP-14735
> URL: https://issues.apache.org/jira/browse/HADOOP-14735
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
>Affects Versions: HADOOP-13345
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Minor
>
> in parallel test runs, {{ITestS3AEncryptionSSEC}} is failing (repeatedly) by
> not throwing an exception when attempting to rename one file to another using
> a different client key
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14735) ITestS3AEncryptionSSEC failing in parallel s3guard runs
[
https://issues.apache.org/jira/browse/HADOOP-14735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16114524#comment-16114524
]
Steve Loughran commented on HADOOP-14735:
-
{code}
Running org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEC
Tests run: 10, Failures: 0, Errors: 1, Skipped: 5, Time elapsed: 15.874 sec <<<
FAILURE! - in org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEC
testCreateFileThenMoveWithDifferentSSECKey(org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEC)
Time elapsed: 1.202 sec <<< ERROR!
java.lang.Exception: Exception should be thrown.
at
org.apache.hadoop.fs.s3a.ITestS3AEncryptionSSEC.lambda$testCreateFileThenMoveWithDifferentSSECKey$2(ITestS3AEncryptionSSEC.java:147)
{code}
> ITestS3AEncryptionSSEC failing in parallel s3guard runs
> ---
>
> Key: HADOOP-14735
> URL: https://issues.apache.org/jira/browse/HADOOP-14735
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
>Affects Versions: HADOOP-13345
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Minor
>
> in parallel test runs, {{ITestS3AEncryptionSSEC}} is failing (repeatedly) by
> not throwing an exception when attempting to rename one file to another using
> a different client key
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
