[
https://issues.apache.org/jira/browse/HDFS-6773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14081959#comment-14081959
]
Stephen Chu commented on HDFS-6773:
-----------------------------------
Thanks, Daryn. That sounds like a good approach.
I see 2 tests that
{{EditLogFileOutputStream.setShouldSkipFsyncForTesting(false);}}:
TestFsDatasetCache.java
TestCacheDirectives.java
Checked with Andrew and Colin, and we think that fsync is probably not a
requirement for the caching tests because the unit tests aren't aimed to be run
with a power-cycle in between. Will look into it more, as well as go through
the rest of HDFS tests to see if any need fsync.
> MiniDFSCluster can run dramatically faster
> ------------------------------------------
>
> Key: HDFS-6773
> URL: https://issues.apache.org/jira/browse/HDFS-6773
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: namenode
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Daryn Sharp
> Assignee: Stephen Chu
>
> The mini cluster is unnecessarily running with durable edit logs. The
> following change cut runtime of a single test from ~30s to ~10s.
> {code}EditLogFileOutputStream.setShouldSkipFsyncForTesting(true);{code}
> The mini cluster should default to this behavior after identifying the few
> edit log tests that probably depend on durable logs.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
