[
https://issues.apache.org/jira/browse/HADOOP-13998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16033340#comment-16033340
]
Aaron Fabbri commented on HADOOP-13998:
---------------------------------------
Thank you for the comments [~liuml07] and [[email protected]].
{quote}
what functional tests have people done?
{quote}
We've done quite a bit of functional testing. We've run our standard
downstream Hive, Spark, MR, Impala, scale, and performance tests. For
performance, we generally saw similar or better performance with S3Guard
enabled (due to short circuit getFileStatus()).
{quote}
Need to look at ... perf on non-s3guard codepaths is impacted, e.g. by new
requests
{quote}
This is a good point. Do you prefer timing-based microbenchmarks, or S3
request statistics (counts)?
> initial s3guard preview
> -----------------------
>
> Key: HADOOP-13998
> URL: https://issues.apache.org/jira/browse/HADOOP-13998
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Reporter: Steve Loughran
>
> JIRA to link in all the things we think are needed for a preview/merge into
> trunk
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
