Re: data replication if cluster replication is enabled later

had your table column family REPLICATION_SCOPE set to '1', but no > replication peer added, then no data inserted/modified prior to having a > peer added would get replicated. > > Em seg., 20 de jan. de 2020 às 00:08, sudhir patil < > spatil.sud...@gmail.com> > escreveu: >

data replication if cluster replication is enabled later

Have query regarding data replication in hbase, in case when cluster replication is enabled after data is inserted to table. If we have existing hbase table with replication enabled & later point in time hbase cluster replication is enabled. Is only data saved after cluster replication enabled

Any issues, if we enable table level replication when cluster replication is disabled

Hi, Will there be any issues, if we enable table level replication (REPLICATION_SCOPE=>1), when cluster replication is disabled? Will there be any issues with WAL log rollover or accumulation? Thanks, Sudhir

Re: Stripe Compactions Stability

Have you considered below options to reduce number/time of compactions? - Reduce memstore flushes to create fewer hfiles there by reducing number of compactions. By setting hbase.hregion.memstore.flush.size and other parameters. - hbase.offpeak.start & end , so that compactions triggered during

Re: How to improve HBase read performance.

HBASE performance highly dependant on query & row key format. Can you share few rowkeys, query format? also what is encoding you are using? On Thu, May 24, 2018 at 8:38 PM, Kang Minwoo wrote: > 5B logs a day? > => Yes, 5B/day > > You store a single log into a single

Re: Which monitoring metrics to alert on?

Few important thingsto monitor from top of head Compaction queue size, compaction size ( size of all files in compaction) GC pause time, number gc (highly co rellated to compactions) Ipc read write call size Slow query logs Number of failed regions from canary tests Replication queue size Its

Re: Region count for a table not matching between prod and cob where one way replication is enabled from prod to cob

Regions in both clusters need not have to match, each server independently manages its regions depending on split, compactions etc number of regions in both servers won't be same. If you want to verify both servers are replicated correctly you have to run below command sudo -u hbase hbase

Re: Strategies to query efficiently in HBase

Your row key looks good, only part not sure is why ur appending with 0x you could have just appended number to string. But even in the current format it should work. Can you try scan with very small limit? to check if timeout is because of large data you fetching or issue is something else. On

Re: OutOfMemoryError: Direct buffer memory on PUT

If your cell size is greater than 100KB its recommended to use MOB's https://www.cloudera.com/documentation/enterprise/5-4-x/topics/admin_hbase_mob.html, can you give it a try? On Tue, Oct 10, 2017 at 1:41 AM, Ted Yu wrote: > Daniel: > Does the version you use contain

Re: Is possible make bidirectional map key<->value?

coprocessor to achieve suggestion 1 On Sun, Oct 8, 2017 at 8:08 AM, Andrzej <borucki_andr...@wp.pl> wrote: > W dniu 08.10.2017 o 02:05, sudhir patil pisze: > >> What do you mean backward? is it like given index get map address? >> > > given index -> I get address string >

Re: Is possible make bidirectional map key<->value?

What do you mean backward? is it like given index get map address? On Sat, Oct 7, 2017 at 9:57 PM, Andrzej wrote: > Is possible such thing:? > two columns: first is bitcoin address, second is index 1,2,3..(0 is > reserved for no_found) > map address->index: > we get row

Re: Strategies to query efficiently in HBase

1> surprising that your range scan times out. Could you share some insert row keys(after hashing) and start & stop rowkeys you are using to scan/query? Row keys design is very important, it has to match your retrieval pattern. 2> Yes, its Hbase is best as long you are doing range scan or to get

RE: Best way to disable & enable HBASE replication

Thanks Chein. Yes, disable_peer and enable_peer worked without any issues. On Oct 5, 2016 6:02 AM, "Chien Le" wrote: > The documentation for disabling the peer sounds wrong, I think it applies > to option #1, not #2. > > From my memory, disabling/re-enabling the peer did

Re: Loading HBase table into HDFS

You can use export command, but not sure if u can export just one column family http://hbase.apache.org/0.94/book/ops_mgt.html#export On Sep 21, 2016 10:42 PM, "Dima Spivak" wrote: > Hey Karthik, > > This blog post [1] by our very own JD Cryans is a good place to start >

Re: Issues with Spark On Hbase Connector

Ok, thanks for the link Ted On Aug 29, 2016 9:54 AM, "Ted Yu" wrote: > For hortonworks product(s), consider raising question on > https://community.hortonworks.com > > FYI > > On Sun, Aug 28, 2016 at 6:45 PM, spats wrote: > > > Regarding hbase

Re: Hbase replication between 0.98.6 and 1.2.0 versions

Great, thanks Ted. On Aug 26, 2016 7:29 PM, "Ted Yu" wrote: > Replication between 0.98.6 and 1.2.0 should work. > > Thanks > > > On Aug 26, 2016, at 1:59 AM, spats wrote: > > > > > > Does hbase replication works between different versions 0.98.6

Re: Good connector libraries for Spark connecting to Hbase for Spark 1.3 Hbase 1.0

Connecting to kerborised hbase from spark is fixed in spark 1.4 , don't think 1.3 works because kerberos issues. https://issues.apache.org/jira/plugins/servlet/mobile#issue/SPARK-6918 On Apr 23, 2016 5:35 AM, "Sean Busbey" wrote: > The HBase-Downstreamer project has an

Re: Stripe Compactions - recommended/stable in 0.98?

gt; stable yet. Maybe someone else does? > > On Fri, Dec 11, 2015 at 9:36 PM, sudhir patil <spatil.sud...@gmail.com> > wrote: > > > It would be great if some one can reply about stability of stripe > > compactions. > > > > Our performance tests with s

Re: Stripe Compactions - recommended/stable in 0.98?

It would be great if some one can reply about stability of stripe compactions. Our performance tests with stripe compactions show much better results compared to default compaction, but what worries me is this feature is still marked as experimental in hbase book, also i have seen issues while

How to change blocksize for existing hbase table? Does alter table works?

I want to change block size of 3xisting table, So is alter table as mentioned below, will this change block size for my table? Also do I need to run major_compaction after alter table. disable 'table1' alter 'table1', { NAME => 'f1', BLOCKSIZE => '16384', COMPRESSION => 'SNAPPY',

Re: How to change blocksize for existing hbase table? Does alter table works?

Alter table do work for changing block size, http://www.cloudera.com/content/www/en-us/documentation/enterprise/5-3-x/topics/admin_configure_blocksize.html On Thu, Nov 26, 2015 at 7:18 PM, sudhir patil <spatil.sud...@gmail.com> wrote: > > I want to change block size of 3xisti