[
https://issues.apache.org/jira/browse/HADOOP-14556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16540157#comment-16540157
]
Steve Loughran commented on HADOOP-14556:
-----------------------------------------
AWS extended Assume role lifespans from 1h to 12h in march. So starts to become
possible to do something clever with a bucket issuing role credentials locked
down to just that bucket and the matching DDB table, then we could have the FS
issue that as some token.
Once HADOOP-15583 is in I'll revisit this, see if I can make it a plugin point
and allow for something to generate restricted assumed role secrets. So if I
try to access stevel ireland, it'd create some role with R/W/D access to that,
the matching S3Guard DDB table and full KMS access, marshall that along with
any encryption options and keys & so let you spark-submit with the credentials
passed in *only* for the buckets you are working with. This can guarantee that
queries sent to a cluster can't access any of the other AWS services to which a
user has access to.
> S3A to support Delegation Tokens
> --------------------------------
>
> Key: HADOOP-14556
> URL: https://issues.apache.org/jira/browse/HADOOP-14556
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 2.8.1
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Major
> Attachments: HADOOP-14556-001.patch, HADOOP-14556-002.patch
>
>
> S3A to support delegation tokens where
> * an authenticated client can request a token via
> {{FileSystem.getDelegationToken()}}
> * Amazon's token service is used to request short-lived session secret & id;
> these will be saved in the token and marshalled with jobs
> * A new authentication provider will look for a token for the current user
> and authenticate the user if found
> This will not support renewals; the lifespan of a token will be limited to
> the initial duration. Also, as you can't request an STS token from a
> temporary session, IAM instances won't be able to issue tokens.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
