[
https://issues.apache.org/jira/browse/HADOOP-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12759701#action_12759701
]
Todd Lipcon commented on HADOOP-6248:
-------------------------------------
bq. Performance testing is not something you can do on a virtual system, tricky
w/ functional tests. Benchmarking is a separate problem. You shoudn't be using
your functional tests to assess performance, as the functional tests are
looking at the corner cases, trying to break things, not simulate well-behaved
code.
+1 - however, I think Circus should focus n being a general enough testing
framework that it can be used for *both* functional tests and performance
tests. Some tests can certainly be geared towards testing corner cases - for
example, starting a three-node pseudo-distributed cluster and then kill
-STOPping one of the nodes at an inopportune time. Other tests can be handy
wrappers for existing benchmark suites like TestDFSIO or Gridmix. Yahoo may
have this already internally, but it would be swell to have a day-by-day graph
of trunk's performance on a variety of standard jobs.
> Circus: Proposal and Preliminary Code for a Hadoop System Testing Framework
> ---------------------------------------------------------------------------
>
> Key: HADOOP-6248
> URL: https://issues.apache.org/jira/browse/HADOOP-6248
> Project: Hadoop Common
> Issue Type: New Feature
> Components: test
> Environment: Python, bash
> Reporter: Alex Loddengaard
> Attachments: HADOOP-6248.diff, HADOOP-6248_v2.diff,
> HADOOP-6248_v3.diff
>
>
> This issue contains a proposal and preliminary source code for Circus, a
> Hadoop system testing framework. At a high level, Circus will help Hadoop
> users and QA engineers to run system tests on a configurable Hadoop cluster,
> or distribution of Hadoop. See the comment below for the proposal itself.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
