[ 
https://issues.apache.org/jira/browse/BEAM-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905116#comment-16905116
 ] 

Ismaël Mejía commented on BEAM-7937:
------------------------------------

The requirement of Hadoop 3.2+ is only to support ADLS Gen 2 via 
`hadoop-azure-datalake`, since you are trying use `wasbs`. This should work 
with earlier version of Hadoop (including 2.7.x) by suing instead 
'hadoop-azure'.
https://hadoop.apache.org/docs/current/hadoop-azure/index.html

> Support Hadoop 3.x on Hadoop File System
> ----------------------------------------
>
>                 Key: BEAM-7937
>                 URL: https://issues.apache.org/jira/browse/BEAM-7937
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-java-hadoop-file-system
>            Reporter: Reenu Saluja
>            Priority: Major
>
> I try to get a Beam pipeline to have input from Azure Data Lake Storage Gen 
> 2. ADLS Gen 2 Support Hadoop 3.2+.  I tried using Apache Beam 2.8.1 later on 
> 2.14.0. I am getting below error:
> Error: Caused by: org.apache.hadoop.fs.UnsupportedFileSystemException: No 
> FileSystem for scheme "wasbs"



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

Reply via email to