Soumitra Sulav created HDDS-781:
-----------------------------------
Summary: Ambari HDP NoClassDefFoundError for MR jobs
Key: HDDS-781
URL: https://issues.apache.org/jira/browse/HDDS-781
Project: Hadoop Distributed Data Store
Issue Type: Bug
Components: Ozone Filesystem
Affects Versions: 0.3.0
Reporter: Soumitra Sulav
HDP integrated with Ambari has a
_/usr/hdp/<hdp-version>/hadoop/mapreduce.tar.gz_ file containing all the
libraries needed for a MR job to run and is copied in the yarn containers at
time of execution.
As introducing ozone filesystem, relevant jars need to be packaged as part of
the tar, also the tar is placed as part of _yum install hadoop_ components done
by Ambari during cluster setup.
During an MR Job run, I faced below java.lang.NoClassDefFoundError exceptions :
org/apache/hadoop/fs/ozone/OzoneFileSystem
org/apache/ratis/proto/RaftProtos$ReplicationLevel
org/apache/ratis/thirdparty/com/google/protobuf/ProtocolMessageEnum
Adding the relevant jar in the mentioned tar file resolves the exception.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
