[
https://issues.apache.org/jira/browse/HDDS-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839979#comment-16839979
]
Sammi Chen commented on HDDS-1525:
----------------------------------
[~elek], thanks for the information. I run the same test again after changed
the configuraiton per your suggestions. Teragen reports
"java.lang.NoClassDefFoundError:
org/apache/hadoop/crypto/key/KeyProviderTokenIssuer" exception.
KeyProviderTokenIssuer is defined in hadoop-common-3.2.0.jar. Its full class
name is changed to
"libs/org/apache/hadoop/crypto/key/KeyProviderTokenIssuer.class" in
hadoop-ozone-filesystem-lib-legacy-0.4.0-alpha.jar. It's the reason why
NoClassDefFoundError is throwed.
If I add hadoop-common-3.2.0.jar to the classpath, then it will show following
error.
Caused by: java.lang.LinkageError: loader constraint violation: loader
(instance of org/apache/hadoop/fs/ozone/FilteredClassLoader) previously
initiated loading for a different type with name
"org/apache/hadoop/crypto/key/KeyProvider"
I think resolve the "java.lang.NoClassDefFoundError:
org/apache/hadoop/crypto/key/KeyProviderTokenIssuer" exception is the key to
this issue.
Another point is teragen use AbstractFileSystem to access Ozone.
AbstractFileSystem implemation of Ozone is "OzFs" which always delegates to
OzoneFileSystem. So I think we need a "OzBasicFs" which can delegate to
BasicOzoneFileSystem here for legacy Hadoop, right?
> Mapreduce failure when using Hadoop 2.7.5
> -----------------------------------------
>
> Key: HDDS-1525
> URL: https://issues.apache.org/jira/browse/HDDS-1525
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
> Components: Ozone Filesystem
> Affects Versions: 0.4.0
> Reporter: Sammi Chen
> Priority: Major
> Attachments: teragen.log
>
>
> Integrate Ozone(0.4 branch) with Hadoop 2.7.5, "hdfs dfs -ls /" can pass,
> while teragen failed.
> When add -verbose:class to java options, it shows that class KeyProvider is
> loaded twice by different classloader while it is only loaded once when
> execute "hdfs dfs -ls /"
> All jars under share/ozone/lib are added into hadoop classpath except ozone
> file system current lib jar.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
