[ 
https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16363527#comment-16363527
 ] 

ASF GitHub Bot commented on HADOOP-13972:
-----------------------------------------

Github user ssonker commented on the issue:

    https://github.com/apache/hadoop/pull/339
  
    @steveloughran I have to make some changes in cloudstore (specifically in 
```ADLDiagnosticsInfo.java```) so that it can get the patched/propagated 
properties from ```AdlFileSystem```. Now when I run cloudstore, I get:
    ```
    Hadoop information
    ==================
    
      Hadoop 3.2.0-SNAPSHOT
      Compiled by ssonker on 2018-02-14T04:08Z
      Compiled with protoc 2.5.0
      From source with checksum b89064fa998ad944e87adfda36171356
    
    Diagnostics for filesystem adl://tmphadooptest.azuredatalakestore.net/
    ======================================================================
    
    Azure Datalake connector
    ASF Filesystem Connector to Microsoft Azure Datalake
    https://hadoop.apache.org/docs/current/hadoop-azure-datalake/index.html
    
    System Properties
    =================
    ....
    ....
    
    Selected and Sanitized Configuration Options
    ============================================
    
    fs.adl.oauth2.client.id = "6**********************************1" 
[fs.adl.account.tmphadooptest.oauth2.client.id via [core-site.xml]]
    fs.adl.oauth2.credential = "9******************************************=" 
[fs.adl.account.tmphadooptest.oauth2.credential via [core-site.xml]]
    fs.adl.oauth2.access.token.provider.type = "ClientCredential" 
[core-default.xml]
    fs.adl.oauth2.refresh.token = (unset)
    fs.adl.oauth2.devicecode.clientapp.id = (unset)
    fs.adl.oauth2.msi.port = (unset)
    fs.adl.oauth2.refresh.url = 
"https://login.microsoftonline.com/fa****e1/oauth2/token"; 
[fs.adl.account.tmphadooptest.oauth2.refresh.url via [core-site.xml]]
    adl.feature.client.cache.readahead = (unset)
    adl.feature.client.cache.drop.behind.writes = (unset)
    adl.debug.override.localuserasfileowner = (unset)
    
    Classes
    =======
    
    class org.apache.hadoop.fs.adl.AdlFileSystem was found in 
file:/Users/ssonker/hadoop/hadoop-dist/target/hadoop-3.2.0-SNAPSHOT/share/hadoop/tools/lib/hadoop-azure-datalake-3.2.0-SNAPSHOT.jar
    class com.microsoft.azure.datalake.store.ADLStoreClient was found in 
file:/Users/ssonker/hadoop/hadoop-dist/target/hadoop-3.2.0-SNAPSHOT/share/hadoop/tools/lib/azure-data-lake-store-sdk-2.2.5.jar
    
    Endpoint: https://login.microsoftonline.com/fa****e1/oauth2/token:
    
==============================================================================================
    
    Canonical hostname 52.172.144.29
      IP address 52.172.144.29
    Connecting to https://login.microsoftonline.com/fa****e1/oauth2/token
    Response: 200 : OK
    HTTP response 200 from 
https://login.microsoftonline.com/fa****e1/oauth2/token: OK
    Using proxy: false 
    ....
    ....
    ```


> ADLS to support per-store configuration
> ---------------------------------------
>
>                 Key: HADOOP-13972
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13972
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs/adl
>    Affects Versions: 3.0.0-alpha2
>            Reporter: John Zhuge
>            Assignee: Sharad Sonker
>            Priority: Major
>
> Useful when distcp needs to access 2 Data Lake stores with different SPIs.
> Of course, a workaround is to grant the same SPI access permission to both 
> stores, but sometimes it might not be feasible.
> One idea is to embed the store name in the configuration property names, 
> e.g., {{dfs.adls.oauth2.<store>.client.id}}. Per-store keys will be consulted 
> first, then fall back to the global keys.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

Reply via email to