[ https://issues.apache.org/jira/browse/YARN-11664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17828470#comment-17828470 ]
ASF GitHub Bot commented on YARN-11664: --------------------------------------- shameersss1 commented on PR #6631: URL: https://github.com/apache/hadoop/pull/6631#issuecomment-2007805123 > -1. Please do not change the following `@Public` and `@Evolving` classes: > > * QuotaExceededException.java > > * DSQuotaExceededException.java > > > > https://apache.github.io/hadoop/hadoop-project-dist/hadoop-common/Compatibility.html > > Evolving interfaces must not change between minor releases. > > Can we use ClusterStorageCapacityExceededException (hadoop-common) instead of DSQuotaExceededException/QuotaExceededException (hadoop-hdfs) in YARN source code? > > IOStreamPair.java is `@Private` and I think we can relocate to hadoop-common. ClusterStorageCapacityExceededException is a parent exception of DSQuotaExceededException and hence catching it will serve the purpose as well. I will raise a revision of this change. > Remove HDFS Binaries/Jars Dependency From YARN > ---------------------------------------------- > > Key: YARN-11664 > URL: https://issues.apache.org/jira/browse/YARN-11664 > Project: Hadoop YARN > Issue Type: Improvement > Components: yarn > Reporter: Syed Shameerur Rahman > Priority: Major > Labels: pull-request-available > > In principle Hadoop Yarn is independent of HDFS. It can work with any > filesystem. Currently there exists some code dependency for Yarn with HDFS. > This dependency requires Yarn to bring in some of the HDFS binaries/jars to > its class path. The idea behind this jira is to remove this dependency so > that Yarn can run without HDFS binaries/jars > *Scope* > 1. Non test classes are considered > 2. Some test classes which comes as transitive dependency are considered > *Out of scope* > 1. All test classes in Yarn module is not considered > > -------------------------------------------------------------------------------------------------------------------------------------------------------------------- > A quick search in Yarn module revealed following HDFS dependencies > 1. Constants > {code:java} > import > org.apache.hadoop.hdfs.security.token.delegation.DelegationTokenIdentifier; > import org.apache.hadoop.hdfs.DFSConfigKeys;{code} > > > 2. Exception > {code:java} > import org.apache.hadoop.hdfs.protocol.DSQuotaExceededException; > import org.apache.hadoop.hdfs.protocol.QuotaExceededException; (Comes as a > transitive dependency from DSQuotaExceededException){code} > > 3. Utility > {code:java} > import org.apache.hadoop.hdfs.protocol.datatransfer.IOStreamPair;{code} > > Both Yarn and HDFS depends on *hadoop-common* module, One straight forward > approach is to move all these dependencies to *hadoop-common* module and both > HDFS and Yarn can pick these dependencies. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org