[
https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786356#comment-16786356
]
Yiqun Lin commented on HDFS-12345:
----------------------------------
Thanks for initial work of this, [~smeng] and [~xkrogen], seems a very great
work!
For the previous discussion of the merge work (mainly for [~xkrogen]'s
comments), some comments from me:
{quote}The documentation hasn't been placed where it belongs to work with the
site
{quote}
This will be useful and very needed I think.
{quote}I'm not entirely confident the packaging strategy I've used, with an
overall hadoop-dynamometer module containing the same three submodules as the
GitHub repo, is the right approach. Comments are welcomed.
{quote}
Compared with other modules under hadoop-tools, other module doesn't contain
submodules. So I mean if we can combine current three submoudles to the one.
Also this will be easily for the following integration test.
{quote}The style doesn't match Hadoop (in particular, line length is higher –
lots of reformatting is going to need to be done)
{quote}
This can be quickly fixed and addressed now, :).
{quote}I/we need to make a decision about version compatibility. Dynamometer
was designed to be able to run multiple versions of Hadoop from a single
Dynamometer release. Does this still make sense now that Dynamometer is within
Hadoop itself? I think so, to accommodate scenarios where you have a cluster
running Hadoop version X but you want to test out what an upgrade to Hadoop
version Y might look like.
{quote}
Seems this will not be a serious problem. We cannot promise that Dynamometer
can be compatible with every Hadoop versions, but we recommend that use
Dynamometer test for current Hadoop version.
Anyway, this is a nice work and very looking forward to seeing Dynamometer in
hadoop.
> Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)
> --------------------------------------------------------------------------
>
> Key: HDFS-12345
> URL: https://issues.apache.org/jira/browse/HDFS-12345
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: namenode, test
> Reporter: Zhe Zhang
> Assignee: Siyao Meng
> Priority: Major
> Attachments: HDFS-12345.000.patch, HDFS-12345.001.patch,
> HDFS-12345.002.patch
>
>
> Dynamometer has now been open sourced on our [GitHub
> page|https://github.com/linkedin/dynamometer]. Read more at our [recent blog
> post|https://engineering.linkedin.com/blog/2018/02/dynamometer--scale-testing-hdfs-on-minimal-hardware-with-maximum].
> To encourage getting the tool into the open for others to use as quickly as
> possible, we went through our standard open sourcing process of releasing on
> GitHub. However we are interested in the possibility of donating this to
> Apache as part of Hadoop itself and would appreciate feedback on whether or
> not this is something that would be supported by the community.
> Also of note, previous [discussions on the dev mail
> lists|http://mail-archives.apache.org/mod_mbox/hadoop-hdfs-dev/201707.mbox/%3c98fceffa-faff-4cf1-a14d-4faab6567...@gmail.com%3e]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
