[
https://issues.apache.org/jira/browse/HADOOP-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16489671#comment-16489671
]
Aaron Fabbri commented on HADOOP-14946:
---------------------------------------
Thanks guys.
{quote}NTP logs?
{quote}
Attempt at a joke / me grasping at an explanation for your last stack trace. :)
A bogged-down system should result in "too many items pruned", (since "fresh"
files become "stale") not "not enough items pruned" which is what was different
about your last stack trace. I could only reproduce the former.
{quote}the other one would be to dynamically change the asserts
{quote}
Yeah. We could assert an OR of the two possibilities. That at least gives some
sanity check. Not sure how to do one exact value without a race. Anyways,
will probably just commit this for now since it appears to work, and revisit if
it comes up again–unless you have other desires [[email protected]].
(Aside: Ideally we'd have a Timer or Ticker "fake time source" we could inject
into S3AFileSystem and DynamoDBMS so we could precisely control time without
doing this sleep stuff. Another day).
> S3Guard testPruneCommandCLI can fail
> ------------------------------------
>
> Key: HADOOP-14946
> URL: https://issues.apache.org/jira/browse/HADOOP-14946
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.0.0
> Reporter: Steve Loughran
> Assignee: Gabor Bota
> Priority: Major
> Attachments: HADOOP-14946.001.patch, HADOOP-14946.002.patch
>
>
> The test of the S3Guard CLI prune can sometimes fail on parallel test runs.
> Assumption: it is the parallelism which is causing the problem
> {code}
> org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardToolDynamoDB
> testPruneCommandCLI(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardToolDynamoDB)
> Time elapsed: 10.765 sec <<< FAILURE!
> java.lang.AssertionError: Pruned children count [] expected:<1> but was:<0>
> at org.junit.Assert.fail(Assert.java:88)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
