[
https://issues.apache.org/jira/browse/HBASE-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nick Dimiduk updated HBASE-9806:
--------------------------------
Attachment: HBASE-9806.00.patch
Here's an initial version, based heavily on HFilerPerfEval code. Would be nice
to reduce duplication between the two. Sample output, for reference.
{noformat}
$ ./bin/hbase org.apache.hadoop.hbase.BlockCachePerformanceEvaluation --help
usage: bin/hbase org.apache.hadoop.hbase.BlockCachePerformanceEvaluation
<options>
Options:
-b,--blocksize <arg> Override the default blocksize (65536).
-h,--help Show usage
-i,--iterations <arg> The number of times to run a test (default: 100).
-s,--seed <arg> Specify a seed value for the random generator.
$ ./bin/hbase org.apache.hadoop.hbase.BlockCachePerformanceEvaluation -i 10
2013-10-18 15:56:14,174 INFO [main] hbase.BlockCachePerformanceEvaluation:
Using random seed: 1382136974160
2013-10-18 15:56:14,994 WARN [main] util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
2013-10-18 15:56:15,337 INFO [main] hfile.CacheConfig: Allocating
LruBlockCache with maximum size 386.7 M
2013-10-18 15:56:15,362 INFO [main] util.ChecksumType: Checksum using
org.apache.hadoop.util.PureJavaCrc32
2013-10-18 15:56:15,364 INFO [main] util.ChecksumType: Checksum can use
org.apache.hadoop.util.PureJavaCrc32C
2013-10-18 15:56:15,434 WARN [main] conf.Configuration: hadoop.native.lib is
deprecated. Instead, use io.native.lib.available
2013-10-18 15:56:30,720 INFO [main] hbase.BlockCachePerformanceEvaluation:
Running UniformRandomSmallScanBenchmark 10 time(s).
2013-10-18 15:56:33,194 INFO [main] hbase.BlockCachePerformanceEvaluation:
Running UniformRandomReadBenchmark 10 time(s).
2013-10-18 15:57:51,237 INFO [main] hbase.BlockCachePerformanceEvaluation:
Running GaussianRandomReadBenchmark 10 time(s).
2013-10-18 15:58:07,599 INFO [main] hbase.BlockCachePerformanceEvaluation: Not
able to seekTo 00000-5419
2013-10-18 15:58:34,024 INFO [main] hbase.BlockCachePerformanceEvaluation:
Running SequentialReadBenchmark 10 time(s).
2013-10-18 15:58:39,664 INFO [main] hbase.BlockCachePerformanceEvaluation:
UniformRandomReadBenchmark: [7644, 10228, 8438, 8415, 8310, 7814, 7155, 7033,
6633, 6363], avg: 7803.3 ms.
2013-10-18 15:58:39,665 INFO [main] hbase.BlockCachePerformanceEvaluation:
UniformRandomSmallScanBenchmark: [832, 172, 171, 171, 171, 185, 186, 169, 174,
171], avg: 240.2 ms.
2013-10-18 15:58:39,665 INFO [main] hbase.BlockCachePerformanceEvaluation:
SequentialReadBenchmark: [300, 545, 713, 460, 512, 679, 599, 672, 515, 582],
avg: 557.7 ms.
2013-10-18 15:58:39,665 INFO [main] hbase.BlockCachePerformanceEvaluation:
GaussianRandomReadBenchmark: [4017, 4175, 4790, 4346, 4242, 4690, 4092, 4142,
4217, 4068], avg: 4277.9 ms.
{noformat}
> Add PerfEval tool for BlockCache
> --------------------------------
>
> Key: HBASE-9806
> URL: https://issues.apache.org/jira/browse/HBASE-9806
> Project: HBase
> Issue Type: Test
> Components: Performance, test
> Reporter: Nick Dimiduk
> Assignee: Nick Dimiduk
> Attachments: HBASE-9806.00.patch
>
>
> We have at least three different block caching layers with myriad
> configuration settings. Let's add a tool for evaluating memory allocations
> and configuration combinations with different access patterns.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
