[
https://issues.apache.org/jira/browse/HADOOP-13959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812667#comment-15812667
]
Mingliang Liu commented on HADOOP-13959:
----------------------------------------
+1 for the proposal.
Thanks [[email protected]] for filing this! This is definitely something we
have to do for scaling the S3Guard much better. According to our effort in
[HADOOP-13908], we may have to test this patch carefully especially when
waiting a newly created table for active. [AWS
Forum|https://forums.aws.amazon.com/message.jspa?messageID=759966] has an open
discussion thread.
> S3guard: replace dynamo.describe() call in init with more efficient query
> -------------------------------------------------------------------------
>
> Key: HADOOP-13959
> URL: https://issues.apache.org/jira/browse/HADOOP-13959
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: HADOOP-13345
> Reporter: Steve Loughran
> Priority: Minor
>
> HADOOP-13908 adds initialization when a table isn't created, using the
> {{describe()}} call.
> AWS document this as inefficient, and throttle it. We should be able to get
> away with a simple table lookup as the probe
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
