ycsb-1.0.4 was built with with hbase-0.90.5 and you are usin 0.92, so you need to update ycsb's hbase zookeeper jars. To do that copy the hbase-*.jar and zookeeper-*.jar into the /hadoop/projects/ycsb-0.1.4/hbase-binding/lib directory. And copy your hbase-site.xml into /hadoop/projects/ycsb-0.1.4/hbase-binding/conf directory.
HTH Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Mon, Feb 4, 2013 at 12:17 AM, Mohammad Tariq <[email protected]> wrote: > Hello Dalia, > > Me and Anil are talking about this : > > 1 - git clone http://github.com/brianfrankcooper/YCSB.git > 2 - cd YCSB/ > 3 - mvn compile > > And not compiling through Java > > Warm Regards, > Tariq > https://mtariq.jux.com/ > cloudfront.blogspot.com > > > On Mon, Feb 4, 2013 at 12:14 AM, Dalia Sobhy > <[email protected]>wrote: > >> Hi anil, >> >> How to recompile it ? >> >> Sent from my iPhone >> >> On 2013-02-03, at 8:00 PM, "anil gupta" <[email protected]> wrote: >> >> > Hi Dalia, >> > >> > Recently, i ran into same problem with YCSB. You will need to recompile >> > YCSB with HBase0.92. Download the maven project from yscb site and >> > recompile it with HBase0.92. >> > >> > HTH, >> > Anil Gupta >> > >> > On Sun, Feb 3, 2013 at 9:49 AM, Dalia Sobhy <[email protected] >> >wrote: >> > >> >> >> >> Hello Mohamed, >> >> >> >> Yes Hbase is running good and already I have a table and and some >> records >> >> there. >> >> >> >> I have done what you told me I copied all jar files from lib directory >> to >> >> YSCB/db/hbase/lib/ directory. After restart and writing this command >> >> "./bin/ycsb run hbase -p columnfamily=family -P workloads/workloada", I >> >> receive the same error. >> >> >> >> But I didn't compile, because already I don't have a .java file >> >> >> >> ycsb-0.1.4 directory doesn't contain hbase client java file, it >> contains >> >> only this "hbase-binding-0.1.4.jar" >> >> >> >> So what to do ? >> >> >> >> >> >>> From: [email protected] >> >>> Date: Sun, 3 Feb 2013 22:54:13 +0530 >> >>> Subject: Re: Hbase Read/Write throughput measure >> >>> To: [email protected] >> >>> >> >>> Hello Dalia, >> >>> >> >>> Is your Hbase running OK? Copy the hbase jar from your >> HBASE_HOME >> >>> and all the jars from your HBASE_HOME/lib/ directory to your >> >>> YSCB/db/hbase/lib/ directory, compile it again and restart everything. >> >>> >> >>> Warm Regards, >> >>> Tariq >> >>> https://mtariq.jux.com/ >> >>> cloudfront.blogspot.com >> >>> >> >>> >> >>> On Sun, Feb 3, 2013 at 10:18 PM, Dalia Sobhy < >> [email protected] >> >>> wrote: >> >>> >> >>>> >> >>>> Hello Mohamed, >> >>>> >> >>>> I believe thats not the case. >> >>>> >> >>>> check this blog >> >> >> http://stackoverflow.com/questions/11649824/hbase-error-not-a-hostport-pair >> >>>> >> >>>> It denotes that this error is due to incompatible Hbase client and >> >> server >> >>>> versions, although I am using Hbase server :0.92 and the server is >> the >> >>>> latest one uploaded by ycsb. So I don't know why this is happening. >> >>>> >> >>>> So do you have any idea? >> >>>> >> >>>> This is the cmd I am executing: >> >>>> >> >>>> root@master1:~/ycsb-0.1.4# ./bin/ycsb run hbase -p >> >> columnfamily="family" >> >>>> -P workloads/workloada >> >>>> >> >>>> java -cp >> >> >> /home/dalia/ycsb-0.1.4/gemfire-binding/conf:/home/dalia/ycsb-0.1.4/hbase-binding/lib/hbase-binding-0.1.4.jar:/home/dalia/ycsb-0.1.4/hbase-binding/conf:/home/dalia/ycsb-0.1.4/jdbc-binding/conf:/home/dalia/ycsb-0.1.4/voldemort-binding/conf:/home/dalia/ycsb-0.1.4/infinispan-binding/conf:/home/dalia/ycsb-0.1.4/nosqldb-binding/conf:/home/dalia/ycsb-0.1.4/core/lib/core-0.1.4.jar >> >>>> com.yahoo.ycsb.Client -db com.yahoo.ycsb.db.HBaseClient -p >> >>>> columnfamily=family -P workloads/workloada -t >> >>>> YCSB Client 0.1 >> >>>> Command line: -db com.yahoo.ycsb.db.HBaseClient -p >> columnfamily=family >> >> -P >> >>>> workloads/workloada -t >> >>>> Loading workload... >> >>>> Starting test. >> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client >> >>>> environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 >> 05:32 >> >> GMT >> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client environment: >> >> host.name= >> >>>> master1.medcloud.com >> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client >> >>>> environment:java.version=1.6.0_31 >> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client >> >>>> environment:java.vendor=Sun Microsystems Inc. >> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client >> >>>> environment:java.home=/usr/lib/jvm/j2sdk1.6-oracle/jre >> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client >> >> >> environment:java.class.path=/home/dalia/ycsb-0.1.4/gemfire-binding/conf:/home/dalia/ycsb-0.1.4/hbase-binding/lib/hbase-binding-0.1.4.jar:/home/dalia/ycsb-0.1.4/hbase-binding/conf:/home/dalia/ycsb-0.1.4/jdbc-binding/conf:/home/dalia/ycsb-0.1.4/voldemort-binding/conf:/home/dalia/ycsb-0.1.4/infinispan-binding/conf:/home/dalia/ycsb-0.1.4/nosqldb-binding/conf:/home/dalia/ycsb-0.1.4/core/lib/core-0.1.4.jar >> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client >> >> >> environment:java.library.path=/usr/lib/jvm/j2sdk1.6-oracle/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-oracle/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-oracle/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib >> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client >> >>>> environment:java.io.tmpdir=/tmp >> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client >> >>>> environment:java.compiler=<NA> >> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client environment: >> os.name >> >>>> =Linux >> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client >> >>>> environment:os.arch=amd64 >> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client >> >>>> environment:os.version=3.2.0-23-generic >> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client environment: >> >> user.name >> >>>> =root >> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client >> >>>> environment:user.home=/root >> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client >> >>>> environment:user.dir=/home/dalia/ycsb-0.1.4 >> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Initiating client >> >> connection, >> >>>> connectString=192.168.2.3:2181 sessionTimeout=180000 >> >> watcher=hconnection >> >>>> 13/02/03 18:42:24 INFO zookeeper.ClientCnxn: Opening socket >> connection >> >> to >> >>>> server /192.168.2.3:2181 >> >>>> 13/02/03 18:42:24 INFO zookeeper.ClientCnxn: Socket connection >> >> established >> >>>> to master1.medcloud.com/192.168.2.3:2181, initiating session >> >>>> 13/02/03 18:42:24 INFO zookeeper.ClientCnxn: Session establishment >> >>>> complete on server master1.medcloud.com/192.168.2.3:2181, sessionid >> = >> >>>> 0x13c9b45ac70000a, negotiated timeout = 60000 >> >>>> java.lang.IllegalArgumentException: Not a host:port pair: � >> >>>> [email protected],60020,1359814720801 >> >>>> >> >>>> >> >>>> my hbase-site.xml: >> >>>> >> >>>> <configuration> >> >>>> <property> >> >>>> <name>hbase.rootdir</name> >> >>>> <value>hdfs://192.168.2.3:20001/hbase</value> >> >>>> >> >>>> <!-- <value>hdfs://<HBASE_MASTER_SERVER>:20001/hbase</value>--> >> >>>> <description>The directory shared by region servers. >> >>>> </description> >> >>>> </property> >> >>>> <property> >> >>>> <name>hbase.master</name> >> >>>> <value>192.168.2.3:60000</value> >> >>>> <!--<value><HBASE_MASTER_SERVER>:60000</value>--> >> >>>> <description>The host and port that the HBase master runs at. >> >>>> </description> >> >>>> </property> >> >>>> <property> >> >>>> <name>hbase.zookeeper.quorum</name> >> >>>> <value>192.168.2.3</value> >> >>>> <!--<value><HBASE_MASTER_SERVER></value>--> >> >>>> </property> >> >>>> </configuration> >> >>>> >> >>>> So any help please.... >> >>>> >> >>>> Thanks, >> >>>> >> >>>>> From: [email protected] >> >>>>> Date: Sun, 3 Feb 2013 13:54:28 +0530 >> >>>>> Subject: Re: Hbase Read/Write throughput measure >> >>>>> To: [email protected] >> >>>>> >> >>>>> Hello Dalia, >> >>>>> >> >>>>> I am sorry for late response, courtesy hectic schedule. Add >> >> the >> >>>>> hbase-site.xml file to the classpath and see if it works for you. >> >>>>> >> >>>>> Warm Regards, >> >>>>> Tariq >> >>>>> https://mtariq.jux.com/ >> >>>>> cloudfront.blogspot.com >> >>>>> >> >>>>> >> >>>>> On Sun, Feb 3, 2013 at 3:50 AM, Dalia Sobhy < >> >> [email protected] >> >>>>> wrote: >> >>>>> >> >>>>>> >> >>>>>> I tried yahoo bench mark I got the following error: >> >>>>>> >> >>>>>> java.lang.IllegalArgumentException: Not a host:port >> >>>>>> >> >>>>>> So any help, >> >>>>>> >> >>>>>> Note that I am using hbase 0.92 >> >>>>>> >> >>>>>> I have downloaded the lastest ycsb from github >> >>>>>> >> >>>>>>> From: [email protected] >> >>>>>>> To: [email protected] >> >>>>>>> Subject: RE: Hbase Read/Write throughput measure >> >>>>>>> Date: Sat, 2 Feb 2013 16:47:43 +0200 >> >>>>>>> >> >>>>>>> >> >>>>>>> any help ??!!!!!! >> >>>>>>> >> >>>>>>>> Date: Fri, 1 Feb 2013 17:15:45 -0500 >> >>>>>>>> Subject: Re: Hbase Read/Write throughput measure >> >>>>>>>> From: [email protected] >> >>>>>>>> To: [email protected] >> >>>>>>>> >> >>>>>>>> When you will have figure how the command is working, you will >> >>>> have to >> >>>>>>>> understand the output ;) >> >>>>>>>> >> >>>>>>>> This is how I just tried it from my HBase directory: >> >>>>>>>> bin/hbase org.apache.hadoop.hbase.PerformanceEvaluation >> >> randomRead >> >>>> 10 >> >>>>>>>> >> >>>>>>>> And this is the output (last lines): >> >>>>>>>> 10066326 56314 >> >>>>>>>> 10171183 56385 >> >>>>>>>> 10276040 56579 >> >>>>>>>> 10380897 56553 >> >>>>>>>> >> >>>>>>>> Does ask me what it means ;) I have, so far, no idea. >> >>>>>>>> >> >>>>>>>> JM >> >>>>>>>> >> >>>>>>>> 2013/2/1, Dalia Sobhy <[email protected]>: >> >>>>>>>>> Dear Mohamed, >> >>>>>>>>> >> >>>>>>>>> I checked this link: >> >>>>>>>>> http://wiki.apache.org/hadoop/Hbase/PerformanceEvaluation >> >>>>>>>>> >> >>>>>>>>> But how to use the commands there is no clue, note that I am >> >>>> using >> >>>>>> cloudera >> >>>>>>>>> manager. >> >>>>>>>>> >> >>>>>>>>> The other yahoo link I couldn't understand how to use it. >> >>>>>>>>> >> >>>>>>>>> So any help please?? >> >>>>>>>>> >> >>>>>>>>> Sent from my iPad >> >>>>>>>>> >> >>>>>>>>> On Feb 1, 2013, at 2:32 PM, "Mohammad Tariq" < >> >> [email protected] >> >>>>> >> >>>>>> wrote: >> >>>>>>>>> >> >>>>>>>>>> Hello Dalia, >> >>>>>>>>>> >> >>>>>>>>>> I think the easiest way to measure the read/write >> >>>>>> throughput is >> >>>>>>>>>> to use "PerformanceEvaluation" tool that comes with the >> >> Hbase >> >>>>>>>>>> distribution. It spawns a map-reduce job to do the >> >> reads/writes >> >>>> in >> >>>>>>>>>> parallel. Apart from this there are several other ways to >> >>>> benchmark >> >>>>>> your >> >>>>>>>>>> Hbase cluster like YSCB < >> >>>> https://github.com/brianfrankcooper/YCSB>. >> >>>>>> You >> >>>>>>>>>> might find this >> >>>>>>>>>> link< >> >> http://wiki.apache.org/hadoop/Hbase/PerformanceEvaluation> >> >>>>>> useful >> >>>>>>>>>> that talks about Hbase performance. >> >>>>>>>>>> >> >>>>>>>>>> HTH >> >>>>>>>>>> >> >>>>>>>>>> Warm Regards, >> >>>>>>>>>> Tariq >> >>>>>>>>>> https://mtariq.jux.com/ >> >>>>>>>>>> cloudfront.blogspot.com >> >>>>>>>>>> >> >>>>>>>>>> >> >>>>>>>>>> On Fri, Feb 1, 2013 at 5:41 PM, Dalia Sobhy >> >>>>>>>>>> <[email protected]>wrote: >> >>>>>>>>>> >> >>>>>>>>>>> >> >>>>>>>>>>> Dear all, >> >>>>>>>>>>> >> >>>>>>>>>>> I want to measure the read/write throughput for a code on a >> >>>>>> cluster of >> >>>>>>>>>>> 10 >> >>>>>>>>>>> nodes. So is there any code or way to measure it? >> >>>>>>>>>>> >> >>>>>>>>>>> I have seen in a cloudera-based presentation that hbase >> >>>> read/write >> >>>>>>>>>>> throughput = millions queries per second. >> >>>>>>>>>>> >> >>>>>>>>>>> So any help please?? >> >>>>>>>>>>> >> >>>>>>>>>>> Thanks >> >>>>>>>>>>> >> >>>>>>>>>>> >> >>>>>>>>>>> Best Regards, >> >>>>>>>>>>> Dalia Sobhy >> > >> > >> > >> > -- >> > Thanks & Regards, >> > Anil Gupta >> > >
