Re: Tool to to execute an benchmark for HBase.

2015-01-30 Thread Nishanth S
You are hitting hbase harder now which is important for benchmarking.If there is no data loss it means your hbase cluster is good enough to handle the load.You are simply making more use of the cores from where you launch ycsb process.Write your own workload depending on the record

Re: Tool to to execute an benchmark for HBase.

2015-01-29 Thread Nishanth S
How many instances of ycsb do you run and how many threads do you use per instance.I guess these ops are per instance and you should get similar numbers if you run more instances.In short try running more workload instances... -Nishanth On Thu, Jan 29, 2015 at 8:49 AM, Guillermo Ortiz

Re: Tool to to execute an benchmark for HBase.

2015-01-29 Thread Guillermo Ortiz
Is there any result with that benchmark to compare?? I'm executing the different workloads and for example for 100% Reads in a table with 10Millions of records I only get an performance of 2000operations/sec. I hoped much better performance but I could be wrong. I'd like to know if it's a normal

Re: Tool to to execute an benchmark for HBase.

2015-01-29 Thread Ted Yu
What's the value for hfile.block.cache.size ? By default it is 40%. You may want to increase its value if you're using default. Andrew published some ycsb results : http://people.apache.org/~apurtell/results-ycsb-0.98.8/ycsb -0.98.0-vs-0.98.8.pdf However, I couldn't access the above now.

Re: Tool to to execute an benchmark for HBase.

2015-01-29 Thread Guillermo Ortiz
Yes, I'm using 40%. i can't access to those data either. I don't know how YSCB executes the reads and if they are random and could take advange of the cache. Do you think that it's an acceptable performance? 2015-01-29 16:26 GMT+01:00 Ted Yu yuzhih...@gmail.com: What's the value for

Tool to to execute an benchmark for HBase.

2015-01-28 Thread Guillermo Ortiz
Hi, I'd like to do some benchmarks fo HBase but I don't know what tool could use. I started to make some code but I guess that there're some easier. I've taken a look to JMeter, but I guess that I'd attack directly from Java, JMeter looks great but I don't know if it fits well in this scenario.

Re: Tool to to execute an benchmark for HBase.

2015-01-28 Thread Ted Yu
Guillermo: If you use hbase 0.98.x, please consider Andrew's ycsb repo: https://github.com/apurtell/ycsb/tree/new_hbase_client Cheers On Wed, Jan 28, 2015 at 12:41 PM, Nishanth S nishanth.2...@gmail.com wrote: You can use ycsb for this purpose.See here

Re: Tool to to execute an benchmark for HBase.

2015-01-28 Thread Nishanth S
You can use ycsb for this purpose.See here https://github.com/brianfrankcooper/YCSB/wiki/Getting-Started -Nishanth On Wed, Jan 28, 2015 at 1:37 PM, Guillermo Ortiz konstt2...@gmail.com wrote: Hi, I'd like to do some benchmarks fo HBase but I don't know what tool could use. I started to make

Re: Tool to to execute an benchmark for HBase.

2015-01-28 Thread Guillermo Ortiz
I was checking that web, do you know if there's another possibility since last updated for Cassandra was two years ago and I'd like to compare bothof them with kind of same tool/code. 2015-01-28 22:10 GMT+01:00 Ted Yu yuzhih...@gmail.com: Guillermo: If you use hbase 0.98.x, please consider

Re: Tool to to execute an benchmark for HBase.

2015-01-28 Thread Ted Yu
Maybe ask on Cassandra mailing list for the benchmark tool they use ? Cheers On Wed, Jan 28, 2015 at 1:23 PM, Guillermo Ortiz konstt2...@gmail.com wrote: I was checking that web, do you know if there's another possibility since last updated for Cassandra was two years ago and I'd like to