[
https://issues.apache.org/jira/browse/HADOOP-14205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15934990#comment-15934990
]
John Zhuge commented on HADOOP-14205:
-------------------------------------
The following unit test failures in {{branch-2.8.0}} are also caused by this
JIRA:
{noformat}
TestAzureADTokenProvider.testExcludeAllProviderTypesFromConfig:274->excludeAndTestExpectations:283
expected:<null> but was:<jceks://adl/tmp/test.jceks,
jceks://adl@/my/path/test.jceks>
TestAzureADTokenProvider.testCredentialProviderPathExclusions:261->excludeAndTestExpectations:283
expected:<user:///,jceks://[][email protected]...>
but
was:<user:///,jceks://[adl/user/hrt_qa/sqoopdbpasswd.jceks,jceks://][email protected]...>
{noformat}
Create {{hadoop-tools/hadoop-azure-datalake/src/test/resources/core-site.xml}}
with these 2 properties, the tests will pass:
{noformat}
<property>
<name>fs.adl.impl</name>
<value>org.apache.hadoop.fs.adl.AdlFileSystem</value>
</property>
<property>
<name>fs.AbstractFileSystem.adl.impl</name>
<value>org.apache.hadoop.fs.adl.Adl</value>
</property>
{noformat}
> No FileSystem for scheme: adl
> -----------------------------
>
> Key: HADOOP-14205
> URL: https://issues.apache.org/jira/browse/HADOOP-14205
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/adl
> Affects Versions: 2.8.0
> Reporter: John Zhuge
> Assignee: John Zhuge
> Fix For: 2.9.0, 2.8.1
>
> Attachments: HADOOP-14205.branch-2.001.patch,
> HADOOP-14205.branch-2.002.patch
>
>
> {noformat}
> $ bin/hadoop fs -ls /
> ls: No FileSystem for scheme: adl
> {noformat}
> The problem is {{core-default.xml}} misses property {{fs.adl.impl}} and
> {{fs.AbstractFileSystem.adl.impl}}.
> After adding these 2 properties to {{etc/hadoop/core-sitex.xml}}, got this
> error:
> {noformat}
> $ bin/hadoop fs -ls /
> -ls: Fatal internal error
> java.lang.RuntimeException: java.lang.ClassNotFoundException: Class
> org.apache.hadoop.fs.adl.AdlFileSystem not found
> at
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2231)
> at
> org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3207)
> at
> org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3239)
> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:121)
> at
> org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3290)
> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3258)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:470)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:223)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:454)
> at org.apache.hadoop.fs.Path.getFileSystem(Path.java:356)
> at org.apache.hadoop.fs.shell.PathData.expandAsGlob(PathData.java:325)
> at org.apache.hadoop.fs.shell.Command.expandArgument(Command.java:245)
> at org.apache.hadoop.fs.shell.Command.expandArguments(Command.java:228)
> at
> org.apache.hadoop.fs.shell.FsCommand.processRawArguments(FsCommand.java:103)
> at org.apache.hadoop.fs.shell.Command.run(Command.java:175)
> at org.apache.hadoop.fs.FsShell.run(FsShell.java:315)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
> at org.apache.hadoop.fs.FsShell.main(FsShell.java:378)
> Caused by: java.lang.ClassNotFoundException: Class
> org.apache.hadoop.fs.adl.AdlFileSystem not found
> at
> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2137)
> at
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2229)
> ... 18 more
> {noformat}
> The problem is ADLS jars are not copied to {{share/hadoop/tools/lib}}.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
