[
https://issues.apache.org/jira/browse/HADOOP-15692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16595963#comment-16595963
]
Thomas Marquardt commented on HADOOP-15692:
-------------------------------------------
[[email protected]], the ABFS (ADLS Gen 2) design targets parity with the ADL
(ADLS Gen 1) connector. The OAuth implementations are essentially the same,
although that's hard to see because ADL connector source code is largely in the
ADLS Gen 1 SDK.
Regarding your question, we currently don't have support for per-filesystem
config, but that would be interesting to add within the hadoop config system.
The ABFS extensibility model allows you to specify one type to be used as the
DT provider, although you could certainly vary what it does per-filesystem, and
I agree with you that we should pass the filesystem or filesystem URI into
initialize. However, we currently have implementations of
CustomDelegationTokenManager, and need to do a little leg work to determine if
we can still make this change (opened HADOOP-15704 for this). The same goes for
CustomTokenProviderAdaptee, we already have implementations.
Please allow me to push this for now, and we can research whether it is
possible to make the updates to CustomDelegationTokenManager or
CustomTokenProviderAdaptee, versus adding new interfaces in the future when/if
needed.
All tests pass for me against my US storage account, and Yetus gave +1. I will
push this shortly.
*Tests run: 265, Failures: 0, Errors: 0, Skipped: 11*
*Tests run: 1, Failures: 0, Errors: 0, Skipped: 0*
*Tests run: 863, Failures: 0, Errors: 0, Skipped: 262*
*Tests run: 186, Failures: 0, Errors: 0, Skipped: 10*
> ABFS: extensible support for custom oauth
> -----------------------------------------
>
> Key: HADOOP-15692
> URL: https://issues.apache.org/jira/browse/HADOOP-15692
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
> Reporter: Thomas Marquardt
> Assignee: Da Zhou
> Priority: Major
> Attachments: HADOOP-15692-HADOOP-15407-001.patch,
> HADOOP-15692-HADOOP-15407-002.patch
>
>
> ABFS supports oauth in various forms and needs to export interfaces for
> customization of FileSystem.getDelegationToken and getAccessToken.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
