[
https://issues.apache.org/jira/browse/HBASE-4916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phabricator updated HBASE-4916:
-------------------------------
Attachment: HBASE-4916.D741.1.patch
cgist requested code review of "HBASE-4916 [jira] LoadTest MR Job".
Reviewers: JIRA
MR-based load tester with pluggable workloads
This is a new load tester for HBase which supports pluggable workloads
and more flexibility in configuring how the load is exercised. This load
tester runs as a native map reduce job. Interfaces which define the
workloads can be extended for specific testing. The intensity of a load
can be controlled by the number of clients, number of threads and
desired operations per second.
Add a script to start a streaming map-reduce job where each map tasks runs an
instance of the load tester for a partition of the key-space. Ensure that the
load tester takes a parameter indicating the start key for write operations.
TEST PLAN
EMPTY
REVISION DETAIL
https://reviews.facebook.net/D741
AFFECTED FILES
src/main/java/org/apache/hadoop/hbase/loadtest/CompositeOperationGenerator.java
src/main/java/org/apache/hadoop/hbase/loadtest/DataGenerator.java
src/main/java/org/apache/hadoop/hbase/loadtest/GetGenerator.java
src/main/java/org/apache/hadoop/hbase/loadtest/GetOperation.java
src/main/java/org/apache/hadoop/hbase/loadtest/KeyCounter.java
src/main/java/org/apache/hadoop/hbase/loadtest/MixedWorkloadGenerator.java
src/main/java/org/apache/hadoop/hbase/loadtest/Operation.java
src/main/java/org/apache/hadoop/hbase/loadtest/OperationGenerator.java
src/main/java/org/apache/hadoop/hbase/loadtest/PutGenerator.java
src/main/java/org/apache/hadoop/hbase/loadtest/PutOperation.java
src/main/java/org/apache/hadoop/hbase/loadtest/PutReGenerator.java
src/main/java/org/apache/hadoop/hbase/loadtest/RandomDataGenerator.java
src/main/java/org/apache/hadoop/hbase/loadtest/SeparateWorkloadGenerator.java
src/main/java/org/apache/hadoop/hbase/loadtest/StatsCollector.java
src/main/java/org/apache/hadoop/hbase/loadtest/VersionWorkloadGenerator.java
src/main/java/org/apache/hadoop/hbase/loadtest/Workload.java
src/main/java/org/apache/hadoop/hbase/mapreduce/Driver.java
src/main/java/org/apache/hadoop/hbase/mapreduce/LoadTest.java
MANAGE HERALD DIFFERENTIAL RULES
https://reviews.facebook.net/herald/view/differential/
WHY DID I GET THIS EMAIL?
https://reviews.facebook.net/herald/transcript/1587/
Tip: use the X-Herald-Rules header to filter Herald messages in your client.
> LoadTest MR Job
> ---------------
>
> Key: HBASE-4916
> URL: https://issues.apache.org/jira/browse/HBASE-4916
> Project: HBase
> Issue Type: Sub-task
> Components: client, regionserver
> Reporter: Nicolas Spiegelberg
> Assignee: Christopher Gist
> Fix For: 0.94.0
>
> Attachments: HBASE-4916.D741.1.patch
>
>
> Add a script to start a streaming map-reduce job where each map tasks runs an
> instance of the load tester for a partition of the key-space. Ensure that the
> load tester takes a parameter indicating the start key for write operations.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira