Hello Dalia,
Me and Anil are talking about this :
1 - git clone http://github.com/brianfrankcooper/YCSB.git
2 - cd YCSB/
3 - mvn compile
And not compiling through Java
Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Mon, Feb 4, 2013 at 12:14 AM, Dalia Sobhy <[email protected]>wrote:
> Hi anil,
>
> How to recompile it ?
>
> Sent from my iPhone
>
> On 2013-02-03, at 8:00 PM, "anil gupta" <[email protected]> wrote:
>
> > Hi Dalia,
> >
> > Recently, i ran into same problem with YCSB. You will need to recompile
> > YCSB with HBase0.92. Download the maven project from yscb site and
> > recompile it with HBase0.92.
> >
> > HTH,
> > Anil Gupta
> >
> > On Sun, Feb 3, 2013 at 9:49 AM, Dalia Sobhy <[email protected]
> >wrote:
> >
> >>
> >> Hello Mohamed,
> >>
> >> Yes Hbase is running good and already I have a table and and some
> records
> >> there.
> >>
> >> I have done what you told me I copied all jar files from lib directory
> to
> >> YSCB/db/hbase/lib/ directory. After restart and writing this command
> >> "./bin/ycsb run hbase -p columnfamily=family -P workloads/workloada", I
> >> receive the same error.
> >>
> >> But I didn't compile, because already I don't have a .java file
> >>
> >> ycsb-0.1.4 directory doesn't contain hbase client java file, it contains
> >> only this "hbase-binding-0.1.4.jar"
> >>
> >> So what to do ?
> >>
> >>
> >>> From: [email protected]
> >>> Date: Sun, 3 Feb 2013 22:54:13 +0530
> >>> Subject: Re: Hbase Read/Write throughput measure
> >>> To: [email protected]
> >>>
> >>> Hello Dalia,
> >>>
> >>> Is your Hbase running OK? Copy the hbase jar from your
> HBASE_HOME
> >>> and all the jars from your HBASE_HOME/lib/ directory to your
> >>> YSCB/db/hbase/lib/ directory, compile it again and restart everything.
> >>>
> >>> Warm Regards,
> >>> Tariq
> >>> https://mtariq.jux.com/
> >>> cloudfront.blogspot.com
> >>>
> >>>
> >>> On Sun, Feb 3, 2013 at 10:18 PM, Dalia Sobhy <
> [email protected]
> >>> wrote:
> >>>
> >>>>
> >>>> Hello Mohamed,
> >>>>
> >>>> I believe thats not the case.
> >>>>
> >>>> check this blog
> >>
> http://stackoverflow.com/questions/11649824/hbase-error-not-a-hostport-pair
> >>>>
> >>>> It denotes that this error is due to incompatible Hbase client and
> >> server
> >>>> versions, although I am using Hbase server :0.92 and the server is the
> >>>> latest one uploaded by ycsb. So I don't know why this is happening.
> >>>>
> >>>> So do you have any idea?
> >>>>
> >>>> This is the cmd I am executing:
> >>>>
> >>>> root@master1:~/ycsb-0.1.4# ./bin/ycsb run hbase -p
> >> columnfamily="family"
> >>>> -P workloads/workloada
> >>>>
> >>>> java -cp
> >>
> /home/dalia/ycsb-0.1.4/gemfire-binding/conf:/home/dalia/ycsb-0.1.4/hbase-binding/lib/hbase-binding-0.1.4.jar:/home/dalia/ycsb-0.1.4/hbase-binding/conf:/home/dalia/ycsb-0.1.4/jdbc-binding/conf:/home/dalia/ycsb-0.1.4/voldemort-binding/conf:/home/dalia/ycsb-0.1.4/infinispan-binding/conf:/home/dalia/ycsb-0.1.4/nosqldb-binding/conf:/home/dalia/ycsb-0.1.4/core/lib/core-0.1.4.jar
> >>>> com.yahoo.ycsb.Client -db com.yahoo.ycsb.db.HBaseClient -p
> >>>> columnfamily=family -P workloads/workloada -t
> >>>> YCSB Client 0.1
> >>>> Command line: -db com.yahoo.ycsb.db.HBaseClient -p columnfamily=family
> >> -P
> >>>> workloads/workloada -t
> >>>> Loading workload...
> >>>> Starting test.
> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client
> >>>> environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32
> >> GMT
> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client environment:
> >> host.name=
> >>>> master1.medcloud.com
> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client
> >>>> environment:java.version=1.6.0_31
> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client
> >>>> environment:java.vendor=Sun Microsystems Inc.
> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client
> >>>> environment:java.home=/usr/lib/jvm/j2sdk1.6-oracle/jre
> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client
> >>
> environment:java.class.path=/home/dalia/ycsb-0.1.4/gemfire-binding/conf:/home/dalia/ycsb-0.1.4/hbase-binding/lib/hbase-binding-0.1.4.jar:/home/dalia/ycsb-0.1.4/hbase-binding/conf:/home/dalia/ycsb-0.1.4/jdbc-binding/conf:/home/dalia/ycsb-0.1.4/voldemort-binding/conf:/home/dalia/ycsb-0.1.4/infinispan-binding/conf:/home/dalia/ycsb-0.1.4/nosqldb-binding/conf:/home/dalia/ycsb-0.1.4/core/lib/core-0.1.4.jar
> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client
> >>
> environment:java.library.path=/usr/lib/jvm/j2sdk1.6-oracle/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-oracle/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-oracle/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client
> >>>> environment:java.io.tmpdir=/tmp
> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client
> >>>> environment:java.compiler=<NA>
> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client environment:
> os.name
> >>>> =Linux
> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client
> >>>> environment:os.arch=amd64
> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client
> >>>> environment:os.version=3.2.0-23-generic
> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client environment:
> >> user.name
> >>>> =root
> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client
> >>>> environment:user.home=/root
> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Client
> >>>> environment:user.dir=/home/dalia/ycsb-0.1.4
> >>>> 13/02/03 18:42:24 INFO zookeeper.ZooKeeper: Initiating client
> >> connection,
> >>>> connectString=192.168.2.3:2181 sessionTimeout=180000
> >> watcher=hconnection
> >>>> 13/02/03 18:42:24 INFO zookeeper.ClientCnxn: Opening socket connection
> >> to
> >>>> server /192.168.2.3:2181
> >>>> 13/02/03 18:42:24 INFO zookeeper.ClientCnxn: Socket connection
> >> established
> >>>> to master1.medcloud.com/192.168.2.3:2181, initiating session
> >>>> 13/02/03 18:42:24 INFO zookeeper.ClientCnxn: Session establishment
> >>>> complete on server master1.medcloud.com/192.168.2.3:2181, sessionid =
> >>>> 0x13c9b45ac70000a, negotiated timeout = 60000
> >>>> java.lang.IllegalArgumentException: Not a host:port pair: �
> >>>> [email protected],60020,1359814720801
> >>>>
> >>>>
> >>>> my hbase-site.xml:
> >>>>
> >>>> <configuration>
> >>>> <property>
> >>>> <name>hbase.rootdir</name>
> >>>> <value>hdfs://192.168.2.3:20001/hbase</value>
> >>>>
> >>>> <!-- <value>hdfs://<HBASE_MASTER_SERVER>:20001/hbase</value>-->
> >>>> <description>The directory shared by region servers.
> >>>> </description>
> >>>> </property>
> >>>> <property>
> >>>> <name>hbase.master</name>
> >>>> <value>192.168.2.3:60000</value>
> >>>> <!--<value><HBASE_MASTER_SERVER>:60000</value>-->
> >>>> <description>The host and port that the HBase master runs at.
> >>>> </description>
> >>>> </property>
> >>>> <property>
> >>>> <name>hbase.zookeeper.quorum</name>
> >>>> <value>192.168.2.3</value>
> >>>> <!--<value><HBASE_MASTER_SERVER></value>-->
> >>>> </property>
> >>>> </configuration>
> >>>>
> >>>> So any help please....
> >>>>
> >>>> Thanks,
> >>>>
> >>>>> From: [email protected]
> >>>>> Date: Sun, 3 Feb 2013 13:54:28 +0530
> >>>>> Subject: Re: Hbase Read/Write throughput measure
> >>>>> To: [email protected]
> >>>>>
> >>>>> Hello Dalia,
> >>>>>
> >>>>> I am sorry for late response, courtesy hectic schedule. Add
> >> the
> >>>>> hbase-site.xml file to the classpath and see if it works for you.
> >>>>>
> >>>>> Warm Regards,
> >>>>> Tariq
> >>>>> https://mtariq.jux.com/
> >>>>> cloudfront.blogspot.com
> >>>>>
> >>>>>
> >>>>> On Sun, Feb 3, 2013 at 3:50 AM, Dalia Sobhy <
> >> [email protected]
> >>>>> wrote:
> >>>>>
> >>>>>>
> >>>>>> I tried yahoo bench mark I got the following error:
> >>>>>>
> >>>>>> java.lang.IllegalArgumentException: Not a host:port
> >>>>>>
> >>>>>> So any help,
> >>>>>>
> >>>>>> Note that I am using hbase 0.92
> >>>>>>
> >>>>>> I have downloaded the lastest ycsb from github
> >>>>>>
> >>>>>>> From: [email protected]
> >>>>>>> To: [email protected]
> >>>>>>> Subject: RE: Hbase Read/Write throughput measure
> >>>>>>> Date: Sat, 2 Feb 2013 16:47:43 +0200
> >>>>>>>
> >>>>>>>
> >>>>>>> any help ??!!!!!!
> >>>>>>>
> >>>>>>>> Date: Fri, 1 Feb 2013 17:15:45 -0500
> >>>>>>>> Subject: Re: Hbase Read/Write throughput measure
> >>>>>>>> From: [email protected]
> >>>>>>>> To: [email protected]
> >>>>>>>>
> >>>>>>>> When you will have figure how the command is working, you will
> >>>> have to
> >>>>>>>> understand the output ;)
> >>>>>>>>
> >>>>>>>> This is how I just tried it from my HBase directory:
> >>>>>>>> bin/hbase org.apache.hadoop.hbase.PerformanceEvaluation
> >> randomRead
> >>>> 10
> >>>>>>>>
> >>>>>>>> And this is the output (last lines):
> >>>>>>>> 10066326 56314
> >>>>>>>> 10171183 56385
> >>>>>>>> 10276040 56579
> >>>>>>>> 10380897 56553
> >>>>>>>>
> >>>>>>>> Does ask me what it means ;) I have, so far, no idea.
> >>>>>>>>
> >>>>>>>> JM
> >>>>>>>>
> >>>>>>>> 2013/2/1, Dalia Sobhy <[email protected]>:
> >>>>>>>>> Dear Mohamed,
> >>>>>>>>>
> >>>>>>>>> I checked this link:
> >>>>>>>>> http://wiki.apache.org/hadoop/Hbase/PerformanceEvaluation
> >>>>>>>>>
> >>>>>>>>> But how to use the commands there is no clue, note that I am
> >>>> using
> >>>>>> cloudera
> >>>>>>>>> manager.
> >>>>>>>>>
> >>>>>>>>> The other yahoo link I couldn't understand how to use it.
> >>>>>>>>>
> >>>>>>>>> So any help please??
> >>>>>>>>>
> >>>>>>>>> Sent from my iPad
> >>>>>>>>>
> >>>>>>>>> On Feb 1, 2013, at 2:32 PM, "Mohammad Tariq" <
> >> [email protected]
> >>>>>
> >>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> Hello Dalia,
> >>>>>>>>>>
> >>>>>>>>>> I think the easiest way to measure the read/write
> >>>>>> throughput is
> >>>>>>>>>> to use "PerformanceEvaluation" tool that comes with the
> >> Hbase
> >>>>>>>>>> distribution. It spawns a map-reduce job to do the
> >> reads/writes
> >>>> in
> >>>>>>>>>> parallel. Apart from this there are several other ways to
> >>>> benchmark
> >>>>>> your
> >>>>>>>>>> Hbase cluster like YSCB <
> >>>> https://github.com/brianfrankcooper/YCSB>.
> >>>>>> You
> >>>>>>>>>> might find this
> >>>>>>>>>> link<
> >> http://wiki.apache.org/hadoop/Hbase/PerformanceEvaluation>
> >>>>>> useful
> >>>>>>>>>> that talks about Hbase performance.
> >>>>>>>>>>
> >>>>>>>>>> HTH
> >>>>>>>>>>
> >>>>>>>>>> Warm Regards,
> >>>>>>>>>> Tariq
> >>>>>>>>>> https://mtariq.jux.com/
> >>>>>>>>>> cloudfront.blogspot.com
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> On Fri, Feb 1, 2013 at 5:41 PM, Dalia Sobhy
> >>>>>>>>>> <[email protected]>wrote:
> >>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>> Dear all,
> >>>>>>>>>>>
> >>>>>>>>>>> I want to measure the read/write throughput for a code on a
> >>>>>> cluster of
> >>>>>>>>>>> 10
> >>>>>>>>>>> nodes. So is there any code or way to measure it?
> >>>>>>>>>>>
> >>>>>>>>>>> I have seen in a cloudera-based presentation that hbase
> >>>> read/write
> >>>>>>>>>>> throughput = millions queries per second.
> >>>>>>>>>>>
> >>>>>>>>>>> So any help please??
> >>>>>>>>>>>
> >>>>>>>>>>> Thanks
> >>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>> Best Regards,
> >>>>>>>>>>> Dalia Sobhy
> >
> >
> >
> > --
> > Thanks & Regards,
> > Anil Gupta
>
