[jira] [Commented] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth S3Guard
[
https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16643102#comment-16643102
]
Hudson commented on HADOOP-15827:
-
SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15145 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/15145/])
HADOOP-15827. NPE in DynamoDBMetadataStore.lambda$listChildren for root
(stevel: rev 7ba1cfdea7f5daf799adc4f0ed2e45f55841a058)
* (edit)
hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/s3guard/DynamoDBMetadataStore.java
> NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth S3Guard
>
>
> Key: HADOOP-15827
> URL: https://issues.apache.org/jira/browse/HADOOP-15827
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
>Affects Versions: 3.3.0
>Reporter: Steve Loughran
>Assignee: Gabor Bota
>Priority: Blocker
> Fix For: 3.3.0
>
> Attachments: HADOOP-15827.001.patch
>
>
> NPE in a test run of {{-Dparallel-tests -DtestsThreadCount=6 -Ds3guard
> -Ddynamodb -Dauthoritative}}
> {code}
> [ERROR] testLSRootDir(org.apache.hadoop.fs.s3a.ITestS3AFileSystemContract)
> Time elapsed: 42.822 s <<< ERROR!
> java.lang.NullPointerException
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth S3Guard
[
https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16643060#comment-16643060
]
Steve Loughran commented on HADOOP-15827:
-
LGTM; and provided the problem reoccurs with me locally I can maybe see if this
makes it go away
+1 committed to trunk
> NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth S3Guard
>
>
> Key: HADOOP-15827
> URL: https://issues.apache.org/jira/browse/HADOOP-15827
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
>Affects Versions: 3.3.0
>Reporter: Steve Loughran
>Assignee: Gabor Bota
>Priority: Blocker
> Fix For: 3.3.0
>
> Attachments: HADOOP-15827.001.patch
>
>
> NPE in a test run of {{-Dparallel-tests -DtestsThreadCount=6 -Ds3guard
> -Ddynamodb -Dauthoritative}}
> {code}
> [ERROR] testLSRootDir(org.apache.hadoop.fs.s3a.ITestS3AFileSystemContract)
> Time elapsed: 42.822 s <<< ERROR!
> java.lang.NullPointerException
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
[
https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642611#comment-16642611
]
Hadoop QA commented on HADOOP-15827:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
22s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 19m
30s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
29s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
20s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m
33s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
12m 17s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
39s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
23s{color} | {color:green} trunk passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
32s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
25s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
25s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
15s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m
28s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
12m 40s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
44s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
19s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 4m
34s{color} | {color:green} hadoop-aws in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
28s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 55m 13s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:4b8c2b1 |
| JIRA Issue | HADOOP-15827 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12942900/HADOOP-15827.001.patch
|
| Optional Tests | dupname asflicense compile javac javadoc mvninstall
mvnsite unit shadedclient findbugs checkstyle |
| uname | Linux 802752d68947 3.13.0-144-generic #193-Ubuntu SMP Thu Mar 15
17:03:53 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/patchprocess/precommit/personality/provided.sh |
| git revision | trunk / 347ea38 |
| maven | version: Apache Maven 3.3.9 |
| Default Java | 1.8.0_181 |
| findbugs | v3.1.0-RC1 |
| Test Results |
https://builds.apache.org/job/PreCommit-HADOOP-Build/15313/testReport/ |
| Max. process+thread count | 306 (vs. ulimit of 1) |
| modules | C: hadoop-tools/hadoop-aws U: hadoop-tools/hadoop-aws |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/15313/console |
| Powered by | Apache Yetus 0.8.0 http://yetus.apache.org |
This message was automatically generated.
> NPE in DynamoDBMetadataStore.lambda$lis
[jira] [Commented] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
[
https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642400#comment-16642400
]
Gabor Bota commented on HADOOP-15827:
-
I hope the issue will be solved with this. Thanks for noticing and creating the
issue!
> NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
>
>
> Key: HADOOP-15827
> URL: https://issues.apache.org/jira/browse/HADOOP-15827
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
>Affects Versions: 3.3.0
>Reporter: Steve Loughran
>Assignee: Gabor Bota
>Priority: Blocker
> Attachments: HADOOP-15827.001.patch
>
>
> NPE in a test run of {{-Dparallel-tests -DtestsThreadCount=6 -Ds3guard
> -Ddynamodb -Dauthoritative}}
> {code}
> [ERROR] testLSRootDir(org.apache.hadoop.fs.s3a.ITestS3AFileSystemContract)
> Time elapsed: 42.822 s <<< ERROR!
> java.lang.NullPointerException
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
[
https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642397#comment-16642397
]
Gabor Bota commented on HADOOP-15827:
-
Thanks, it makes sense now. I was able to reproduce the issue injecting
{{dirPathMeta=null}} in readOp while debugging.
The solution will be just to change
{code:java}
return (metas.isEmpty() && dirPathMeta == null)
{code}
to this
{code:java}
return (metas.isEmpty() || dirPathMeta == null)
{code}
I'll upload a patch but without a test - it would be a pain to write
integration test for this. I hope that's acceptable.
> NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
>
>
> Key: HADOOP-15827
> URL: https://issues.apache.org/jira/browse/HADOOP-15827
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
>Affects Versions: 3.3.0
>Reporter: Steve Loughran
>Assignee: Gabor Bota
>Priority: Blocker
>
> NPE in a test run of {{-Dparallel-tests -DtestsThreadCount=6 -Ds3guard
> -Ddynamodb -Dauthoritative}}
> {code}
> [ERROR] testLSRootDir(org.apache.hadoop.fs.s3a.ITestS3AFileSystemContract)
> Time elapsed: 42.822 s <<< ERROR!
> java.lang.NullPointerException
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
[
https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642373#comment-16642373
]
Steve Loughran commented on HADOOP-15827:
-
A key thing is that in the ? : branch, the : phase may be evaluated while
{{dirPathMeta}} == null; I think that that dirPathMeta,getLastUpdate() call has
to be guarded itself.
> NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
>
>
> Key: HADOOP-15827
> URL: https://issues.apache.org/jira/browse/HADOOP-15827
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
>Affects Versions: 3.3.0
>Reporter: Steve Loughran
>Assignee: Gabor Bota
>Priority: Blocker
>
> NPE in a test run of {{-Dparallel-tests -DtestsThreadCount=6 -Ds3guard
> -Ddynamodb -Dauthoritative}}
> {code}
> [ERROR] testLSRootDir(org.apache.hadoop.fs.s3a.ITestS3AFileSystemContract)
> Time elapsed: 42.822 s <<< ERROR!
> java.lang.NullPointerException
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
[
https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642371#comment-16642371
]
Steve Loughran commented on HADOOP-15827:
-
This is branch HADOOP-15446 so the lines will be different, sorry. There;s an
extra method for the store to build up the AWS access policy needed to access
the data, which will confuse the lines
here's the file I've got
https://github.com/steveloughran/hadoop/blob/s3/HADOOP-14556-delegation-token/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/s3guard/DynamoDBMetadataStore.java
> NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
>
>
> Key: HADOOP-15827
> URL: https://issues.apache.org/jira/browse/HADOOP-15827
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
>Affects Versions: 3.3.0
>Reporter: Steve Loughran
>Assignee: Gabor Bota
>Priority: Blocker
>
> NPE in a test run of {{-Dparallel-tests -DtestsThreadCount=6 -Ds3guard
> -Ddynamodb -Dauthoritative}}
> {code}
> [ERROR] testLSRootDir(org.apache.hadoop.fs.s3a.ITestS3AFileSystemContract)
> Time elapsed: 42.822 s <<< ERROR!
> java.lang.NullPointerException
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
[
https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642286#comment-16642286
]
Gabor Bota commented on HADOOP-15827:
-
But line 644 is just a comment. How can it be?
> NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
>
>
> Key: HADOOP-15827
> URL: https://issues.apache.org/jira/browse/HADOOP-15827
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
>Affects Versions: 3.3.0
>Reporter: Steve Loughran
>Assignee: Gabor Bota
>Priority: Blocker
>
> NPE in a test run of {{-Dparallel-tests -DtestsThreadCount=6 -Ds3guard
> -Ddynamodb -Dauthoritative}}
> {code}
> [ERROR] testLSRootDir(org.apache.hadoop.fs.s3a.ITestS3AFileSystemContract)
> Time elapsed: 42.822 s <<< ERROR!
> java.lang.NullPointerException
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
[
https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642283#comment-16642283
]
Gabor Bota commented on HADOOP-15827:
-
I'm not really sure if this is happening in the return. Based on your stack
[~ste...@apache.org],
https://github.com/apache/hadoop/blob/046b8768af8a07a9e10ce43f538d6ac16e7fa5f3/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/s3guard/DynamoDBMetadataStore.java#L644
and
https://github.com/apache/hadoop/blob/046b8768af8a07a9e10ce43f538d6ac16e7fa5f3/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/s3guard/DynamoDBMetadataStore.java#L616
lines are mentioned, maybe the issue is in line 644.
> NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
>
>
> Key: HADOOP-15827
> URL: https://issues.apache.org/jira/browse/HADOOP-15827
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
>Affects Versions: 3.3.0
>Reporter: Steve Loughran
>Assignee: Gabor Bota
>Priority: Blocker
>
> NPE in a test run of {{-Dparallel-tests -DtestsThreadCount=6 -Ds3guard
> -Ddynamodb -Dauthoritative}}
> {code}
> [ERROR] testLSRootDir(org.apache.hadoop.fs.s3a.ITestS3AFileSystemContract)
> Time elapsed: 42.822 s <<< ERROR!
> java.lang.NullPointerException
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
[
https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642265#comment-16642265
]
Gabor Bota commented on HADOOP-15827:
-
I'm not able to reproduce the issue by running
{{org.apache.hadoop.fs.s3a.ITestS3AFileSystemContract}} alone with the params
you've provided. I'll try to run all the integration tests with verify.
> NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
>
>
> Key: HADOOP-15827
> URL: https://issues.apache.org/jira/browse/HADOOP-15827
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
>Affects Versions: 3.3.0
>Reporter: Steve Loughran
>Assignee: Gabor Bota
>Priority: Blocker
>
> NPE in a test run of {{-Dparallel-tests -DtestsThreadCount=6 -Ds3guard
> -Ddynamodb -Dauthoritative}}
> {code}
> [ERROR] testLSRootDir(org.apache.hadoop.fs.s3a.ITestS3AFileSystemContract)
> Time elapsed: 42.822 s <<< ERROR!
> java.lang.NullPointerException
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
[
https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642218#comment-16642218
]
Gabor Bota commented on HADOOP-15827:
-
I'll check it soon.
> NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
>
>
> Key: HADOOP-15827
> URL: https://issues.apache.org/jira/browse/HADOOP-15827
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
>Affects Versions: 3.3.0
>Reporter: Steve Loughran
>Assignee: Gabor Bota
>Priority: Blocker
>
> NPE in a test run of {{-Dparallel-tests -DtestsThreadCount=6 -Ds3guard
> -Ddynamodb -Dauthoritative}}
> {code}
> [ERROR] testLSRootDir(org.apache.hadoop.fs.s3a.ITestS3AFileSystemContract)
> Time elapsed: 42.822 s <<< ERROR!
> java.lang.NullPointerException
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
[
https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642211#comment-16642211
]
Steve Loughran commented on HADOOP-15827:
-
This is happening in new code from HADOOP-15621; there's a codepath where
dirPathMeta==null but metas!= empty which triggers the NPE.
{code}
return (metas.isEmpty() && dirPathMeta == null)
? null
: new DirListingMetadata(path, metas, isAuthoritative,
dirPathMeta.getLastUpdated());
{code}
[~gabor.bota]: assigning this to you as it seems part of the recent patch
> NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
>
>
> Key: HADOOP-15827
> URL: https://issues.apache.org/jira/browse/HADOOP-15827
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
>Affects Versions: 3.3.0
>Reporter: Steve Loughran
>Priority: Blocker
>
> NPE in a test run of {{-Dparallel-tests -DtestsThreadCount=6 -Ds3guard
> -Ddynamodb -Dauthoritative}}
> {code}
> [ERROR] testLSRootDir(org.apache.hadoop.fs.s3a.ITestS3AFileSystemContract)
> Time elapsed: 42.822 s <<< ERROR!
> java.lang.NullPointerException
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15827) NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
[
https://issues.apache.org/jira/browse/HADOOP-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642206#comment-16642206
]
Steve Loughran commented on HADOOP-15827:
-
{code}
[ERROR] Tests run: 43, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
387.198 s <<< FAILURE! - in org.apache.hadoop.fs.s3a.ITestS3AFileSystemContract
[ERROR] testLSRootDir(org.apache.hadoop.fs.s3a.ITestS3AFileSystemContract)
Time elapsed: 42.822 s <<< ERROR!
java.lang.NullPointerException
at
org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore.lambda$listChildren$4(DynamoDBMetadataStore.java:644)
at org.apache.hadoop.fs.s3a.Invoker.once(Invoker.java:109)
at org.apache.hadoop.fs.s3a.Invoker.lambda$retry$3(Invoker.java:265)
at org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:322)
at org.apache.hadoop.fs.s3a.Invoker.retry(Invoker.java:261)
at org.apache.hadoop.fs.s3a.Invoker.retry(Invoker.java:236)
at
org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore.listChildren(DynamoDBMetadataStore.java:616)
at
org.apache.hadoop.fs.s3a.s3guard.MetadataStoreListFilesIterator.prefetch(MetadataStoreListFilesIterator.java:132)
at
org.apache.hadoop.fs.s3a.s3guard.MetadataStoreListFilesIterator.(MetadataStoreListFilesIterator.java:102)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.innerListFiles(S3AFileSystem.java:3303)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.listFiles(S3AFileSystem.java:3266)
at
org.apache.hadoop.fs.FileSystemContractBaseTest.assertListFilesFinds(FileSystemContractBaseTest.java:850)
at
org.apache.hadoop.fs.FileSystemContractBaseTest.testLSRootDir(FileSystemContractBaseTest.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
{code}
> NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth s3guard
>
>
> Key: HADOOP-15827
> URL: https://issues.apache.org/jira/browse/HADOOP-15827
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
>Affects Versions: 3.2.0
>Reporter: Steve Loughran
>Priority: Blocker
>
> NPE in a test run of {{-Dparallel-tests -DtestsThreadCount=6 -Ds3guard
> -Ddynamodb -Dauthoritative}}
> {code}
> [ERROR] testLSRootDir(org.apache.hadoop.fs.s3a.ITestS3AFileSystemContract)
> Time elapsed: 42.822 s <<< ERROR!
> java.lang.NullPointerException
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
