[
https://issues.apache.org/jira/browse/HDDS-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924876#comment-16924876
]
Steve Loughran commented on HDDS-2097:
--------------------------------------
Take a look at
org.apache.hadoop.fs.s3a.commit.terasort.AbstractCommitTerasortIT to see how we
do it in s3a. Which of course you can already point at hdds
* its driven off a -Dscale option so only runs on scale suites
* and by breaking up each stage into their own ordered test case, you get
better reporting of where problems surface.
* HADOOP-16207 fixes some issues you should also look at
* and you can configure the size of the data for smaller and larger tests
* you need to make sure the test timeout is big enough for large test runs
Why not have a play with those tests against HDDS to see how well they work as
a starting point?
> Add TeraSort to acceptance test
> -------------------------------
>
> Key: HDDS-2097
> URL: https://issues.apache.org/jira/browse/HDDS-2097
> Project: Hadoop Distributed Data Store
> Issue Type: Test
> Reporter: Xiaoyu Yao
> Priority: Major
>
> We may begin with 1GB teragen/terasort/teravalidate.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]