How to tell if I'm using gzip family? Below is the output from vmstat 1:
procs -----------memory---------- ---swap-- -----io---- --system-- -----cpu------ r b swpd free buff cache si so bi bo in cs us sy id wa st 0 0 0 489068 153664 2789984 0 0 0 1 0 0 0 0 100 0 0 0 0 0 489068 153664 2789984 0 0 0 0 1049 155 0 0 100 0 0 0 0 0 489068 153664 2789984 0 0 0 0 1019 152 0 0 100 0 0 0 0 0 489068 153664 2789984 0 0 0 0 1047 182 0 0 100 0 0 0 0 0 489068 153664 2789984 0 0 0 96 1035 176 0 0 90 10 0 Jack. -----Original Message----- From: Andrey Stepachev [mailto:[email protected]] Sent: Monday, September 13, 2010 11:00 AM To: [email protected] Subject: Re: How to speed up Scan -- please help What "vmstat 1" shows? Does gzip family used? 2010/9/13 Jian Lu <[email protected]>: > Hi All, > > I am pulling my hair off here because the Scan takes 40 sec to scan 750,000 > records. I am running HBase 0.20.4 on standalone mode on Linux with 16 GB > RAM, 64-bit CPU/Operating system/JVM. My table is very simple with one > family and five columns, each column contains very small String (employee > name, address, etc.). > > Below is my configuration. Could you all please tell me what I missed? > > config.set("hbase.client.pause", "10000"); > config.set("hbase.client.retries.number", "100"); > config.set("hbase.client.scanner.caching", "10000"); > > table.setScannerCaching(10000); > > scan.setCaching(10000); > scan.setCacheBlocks(false); > > > Thanks a lot! > Jack. >
