[
https://issues.apache.org/jira/browse/HADOOP-3750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated HADOOP-3750:
------------------------------
Attachment: hadoop-3750.patch
Here's a patch which fixes the easier inter-module dependencies. There are a
few left which require a bit more effort/discussion:
h4. Core
* FsShell depends on DistributedFileSystem to call setVerifyChecksum on it.
Should we add setVerifyChecksum to FileSystem? If so we need to make
ChecksumFileSystem honour it.
* HarFileSystem uses LineRecordReader to read lines. Replace with own
line-reading code.
* ReflectionUtils depends on JobConf and JobConfigurable to set config. Not
sure what to do here. Have a MapRed ReflectionUtils that does this extra
configuration?
h4. HDFS
* DataNode, FSNamesystem, SecondaryNameNode all depends on StatusHttpServer
which is in mapred. Split out common part and put in core.
h4. MapRed
* Task depends on DistributedFileSystem to update statistics for all known
filesystems. Should we get this from the FileSystem cache?
> Fix and enforce module dependencies
> -----------------------------------
>
> Key: HADOOP-3750
> URL: https://issues.apache.org/jira/browse/HADOOP-3750
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Tom White
> Fix For: 0.19.0
>
> Attachments: hadoop-3750.patch
>
>
> Since HADOOP-2916 Hadoop Core consists of modules in independent source
> trees: core, hdfs, mapred (and others). The dependencies between them should
> be enforced to avoid cyclic dependencies. At present they all have
> dependencies on each other.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
