[
https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16363527#comment-16363527
]
ASF GitHub Bot commented on HADOOP-13972:
-----------------------------------------
Github user ssonker commented on the issue:
https://github.com/apache/hadoop/pull/339
@steveloughran I have to make some changes in cloudstore (specifically in
```ADLDiagnosticsInfo.java```) so that it can get the patched/propagated
properties from ```AdlFileSystem```. Now when I run cloudstore, I get:
```
Hadoop information
==================
Hadoop 3.2.0-SNAPSHOT
Compiled by ssonker on 2018-02-14T04:08Z
Compiled with protoc 2.5.0
From source with checksum b89064fa998ad944e87adfda36171356
Diagnostics for filesystem adl://tmphadooptest.azuredatalakestore.net/
======================================================================
Azure Datalake connector
ASF Filesystem Connector to Microsoft Azure Datalake
https://hadoop.apache.org/docs/current/hadoop-azure-datalake/index.html
System Properties
=================
....
....
Selected and Sanitized Configuration Options
============================================
fs.adl.oauth2.client.id = "6**********************************1"
[fs.adl.account.tmphadooptest.oauth2.client.id via [core-site.xml]]
fs.adl.oauth2.credential = "9******************************************="
[fs.adl.account.tmphadooptest.oauth2.credential via [core-site.xml]]
fs.adl.oauth2.access.token.provider.type = "ClientCredential"
[core-default.xml]
fs.adl.oauth2.refresh.token = (unset)
fs.adl.oauth2.devicecode.clientapp.id = (unset)
fs.adl.oauth2.msi.port = (unset)
fs.adl.oauth2.refresh.url =
"https://login.microsoftonline.com/fa****e1/oauth2/token";
[fs.adl.account.tmphadooptest.oauth2.refresh.url via [core-site.xml]]
adl.feature.client.cache.readahead = (unset)
adl.feature.client.cache.drop.behind.writes = (unset)
adl.debug.override.localuserasfileowner = (unset)
Classes
=======
class org.apache.hadoop.fs.adl.AdlFileSystem was found in
file:/Users/ssonker/hadoop/hadoop-dist/target/hadoop-3.2.0-SNAPSHOT/share/hadoop/tools/lib/hadoop-azure-datalake-3.2.0-SNAPSHOT.jar
class com.microsoft.azure.datalake.store.ADLStoreClient was found in
file:/Users/ssonker/hadoop/hadoop-dist/target/hadoop-3.2.0-SNAPSHOT/share/hadoop/tools/lib/azure-data-lake-store-sdk-2.2.5.jar
Endpoint: https://login.microsoftonline.com/fa****e1/oauth2/token:
==============================================================================================
Canonical hostname 52.172.144.29
IP address 52.172.144.29
Connecting to https://login.microsoftonline.com/fa****e1/oauth2/token
Response: 200 : OK
HTTP response 200 from
https://login.microsoftonline.com/fa****e1/oauth2/token: OK
Using proxy: false
....
....
```
> ADLS to support per-store configuration
> ---------------------------------------
>
> Key: HADOOP-13972
> URL: https://issues.apache.org/jira/browse/HADOOP-13972
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/adl
> Affects Versions: 3.0.0-alpha2
> Reporter: John Zhuge
> Assignee: Sharad Sonker
> Priority: Major
>
> Useful when distcp needs to access 2 Data Lake stores with different SPIs.
> Of course, a workaround is to grant the same SPI access permission to both
> stores, but sometimes it might not be feasible.
> One idea is to embed the store name in the configuration property names,
> e.g., {{dfs.adls.oauth2.<store>.client.id}}. Per-store keys will be consulted
> first, then fall back to the global keys.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
