Re: Large discrepancy in hdfs hbase rootdir size after copytable operation.

Hi Colin, you might want to consider upgrading. The current stable version is 0.98.4 (soon .5). Even just going to 0.94 will give a lot of new features, stability, and performance. 0.92.x can be upgraded to 0.94.x without any downtime and without any upgrade steps necessary. For an upgrade to

[ANNOUNCE] HBase 0.94.22 is available for download

The HBase Team is pleased to announce the immediate release of HBase 0.94.22. Download it from your favorite Apache mirror [1]. This release has also been pushed to Apache's maven repository. All previous 0.92.x and 0.94.x releases can be upgraded to 0.94.22 via a rolling upgrade without downtime

Re: build hbase runtime from src

See http://hbase.apache.org/book.html#maven.release mvn clean install -DskipTests assembly:single -Prelease Cheers On Fri, Aug 8, 2014 at 6:41 PM, yun peng wrote: > Hi, I want to build an hbase runtime from src file. When I used mvn > package, all the dependencies jars are downloaded into the

build hbase runtime from src

Hi, I want to build an hbase runtime from src file. When I used mvn package, all the dependencies jars are downloaded into the local .m2 repository. I want to build an hbase runtime like what is downloaded from the Apache mirror (e.g. hbase-0.98.4-hadoop2-bin.tar.gz

Re: Large discrepancy in hdfs hbase rootdir size after copytable operation.

I used 0.98.5 RC0 FYI On Fri, Aug 8, 2014 at 1:16 PM, Colin Kincaid Williams wrote: > Not in the hbase shell I have: > > hbase version > 14/08/08 14:16:08 INFO util.VersionInfo: HBase 0.92.1-cdh4.1.3 > 14/08/08 14:16:08 INFO util.VersionInfo: Subversion > > file:///data/1/jenkins/workspace/gen

Re: flush table with AES encryption enabled for CF, randomly wrapException observed

Trying out the at rest encryption feature ​is very much appreciated, but perhaps we can spend a bit more time excluding other issues before declaring an encryption bug. So far there hasn't been one (knock on wood!) but a cursory search of user@hbase might imply the feature is buggy. On Fri, Aug 8

Re: Large discrepancy in hdfs hbase rootdir size after copytable operation.

Not in the hbase shell I have: hbase version 14/08/08 14:16:08 INFO util.VersionInfo: HBase 0.92.1-cdh4.1.3 14/08/08 14:16:08 INFO util.VersionInfo: Subversion file:///data/1/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hbase-0.92.1-cdh4.1.3 -r Unknown 14/08/08 14:16:08 INFO util.Vers

Re: Large discrepancy in hdfs hbase rootdir size after copytable operation.

Using simplified version of your command, I saw the following in shell output (you may have noticed as well): An argument ignored (unknown or overridden): BLOOMFILTER An argument ignored (unknown or overridden): VERSIONS 0 row(s) in 2.1110 seconds Cheers On Fri, Aug 8, 2014 at 12:23 PM, Colin K

Re: Large discrepancy in hdfs hbase rootdir size after copytable operation.

The correct syntax is : create 'ADMd5',{ NAME => 'a', VERSIONS => '1', COMPRESSION => 'SNAPPY', BLOOMFILTER => 'ROW', }, { SPLITS => ['/++ASUZm4u7YsTcF/VtK6Q==', '/zyuFR1VmhJyF4rbWsFnEg==', '0sZYnBd83ul58d1O8I2JnA==', '2+03N7IicZH3ltrqZUX6kQ==', '4+/slRQtkBDU7Px6C9MAbg==', '6+1dGCQ/IBrCsrNQXe/9xQ=

Re: Large discrepancy in hdfs hbase rootdir size after copytable operation.

I have discovered the error. I made the mistake regarding the compression and the bloom filter. The new table doesn't have them enabled, and the old does. However I'm wondering how I can create tables with splits and bf and compression enabled. Shouldn't the following command return an error? hbas

Re: [VOTE] The 1st HBase 0.98.5 release candidate (RC0) is available, vote closing 8/11/2014

+1 - installed -hadoop2 bin tar ball - checked contents, documentation, checksums, etc - inserted some data, checked with raw-scans, flushed, compacted, inserted again, checked again. All good. - downloaded source tarball, checked contents, CHANGES.txt, etc. -- Lars __

Re: IPC Queue Size

awesome, thanks! the resets and such were actually what I've been trying to investigate. Recently switched from 0.94 and 0.98, and finding that periodically things are having issues - lots of retry exceptions. Don't have much information, still looking into it when saw this. By timestamp, this s

Re: serving static images using HBase

Thank you. I'm not "native" python writer, so I see that plugin reads and writes from/to HBase through thrift-server, but I didn't explore integration between thumbor. Thanks again for the explanation. 2014-08-08 17:01 GMT+04:00 Damien Hardy : > Yes it is. > My plugin is just a storage/loader pl

Re: serving static images using HBase

Yes it is. My plugin is just a storage/loader plugin for Thumbor using hbase (via thrift) default are filesystem, mongodb or redis. Thumbor can : * load image from multiple origins (filer, http, s3) or any loader plugin. * Store a copy in storage available (TTL can be implemented to force refr

Re: serving static images using HBase

Damien Hardy, is it true, that your plugin allows: 1. store original images to hbase 2. resize orignal images and persist result back to hbase? 2014-08-08 12:00 GMT+04:00 Damien Hardy : > Hello Serega, > > We use it this way here via a python image manipulation service named > Thumbor > https:

Re: serving static images using HBase

Thanks, look cool! We are going to test-drive it. 2014-08-08 12:09 GMT+04:00 Esteban Gutierrez : > Hi Serega, > > Yes, some have done it already: > http://www.slideshare.net/jacque74/hug-hbase-presentation however there > are > caveats to consider: compactions, splits, sizes of the regions, etc.

Re: flush table with AES encryption enabled for CF, randomly wrapException observed

Good to know Shankar! that would also explain getting an EOF in the client. cheers, esteban. -- Cloudera, Inc. On Fri, Aug 8, 2014 at 2:16 AM, Shankar hiremath < shankar.hirem...@huawei.com> wrote: > Hi Anoop/Esteban, > > I verified it, it not a problem. > > After the analysis we found that

RE: flush table with AES encryption enabled for CF, randomly wrapException observed

Hi Anoop/Esteban, I verified it, it not a problem. After the analysis we found that when our Hbase test client was trying to connect to Hmaster at that time file descriptors in the Hmaster side exhausted and it failed, after providing the sufficient file descriptors to Hmaster it worked fine.

Re: IPC Queue Size

The RequestContext seems to be ok since it hasn't been set. So just decrementing the call size should be enough. cheers, esteban. -- Cloudera, Inc. On Fri, Aug 8, 2014 at 2:10 AM, Esteban Gutierrez wrote: > > Looks like after HBASE-10506 we didn't do what CallRunner used to do > before: cle

Re: IPC Queue Size

Looks like after HBASE-10506 we didn't do what CallRunner used to do before: clear the RequestContext and decrement callQueueSize. Created HBASE-11705 to address this issue. -- Cloudera, Inc. On Fri, Aug 8, 2014 at 1:56 AM, Qiang Tian wrote: > good point. that is a big suspect. > > I c

Re: IPC Queue Size

ps there are so many "Connection reset by peer", why your client reset the connection? :-) On Fri, Aug 8, 2014 at 4:56 PM, Qiang Tian wrote: > good point. that is a big suspect. > > I check your log, ClosedChannelException should be triggered by > call.sendResponseIfReady()(it is the only req

Re: IPC Queue Size

good point. that is a big suspect. I check your log, ClosedChannelException should be triggered by call.sendResponseIfReady()(it is the only request in the queue, so handler send response directly), but at that point the callqueueSize has been decremented. 2014-08-05 00:50:06,727 WARN [RpcServ

Re: serving static images using HBase

Hi Serega, Yes, some have done it already: http://www.slideshare.net/jacque74/hug-hbase-presentation however there are caveats to consider: compactions, splits, sizes of the regions, etc. Currently there is work in progress in https://issues.apache.org/jira/browse/HBASE-11339 and that will help u

Re: serving static images using HBase

Hello Serega, We use it this way here via a python image manipulation service named Thumbor https://github.com/thumbor/thumbor/ + a pluggin of my own : https://github.com/thumbor/thumbor/wiki/Plugins#thumbor_hbase-by-damien-hardy One big advantage is you can use it with lazy loading plugin HBas

serving static images using HBase

Hi, we have 10^8 small jpg/png images each size is 20-100 Kb. They are thumbs. These images are used in many web-sites as static content. Is it good Idea to place them to HBase and serve to users? right now all images are on SSD discs with complicated partitioning and backup procedures. It becomes

RE: flush table with AES encryption enabled for CF, randomly wrapException observed

Hi Anoop/ Esteban, I will check it, as per your below suggestions, And I will update you the result. Thanks -Shankar This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is li