Re: Question regards sudden drop of compactionQueueLength metric

2024-05-20 Thread Wellington Chevreuil
By the description, it seems compaction of a specific subset of regions is taking a long time to complete, filling all the compaction threads whilst all other compaction requests are queued waiting for these long ones to complete. Once these long compassions are finished, the queued ones are

Re: Re: INDEX_BLOCK_ENCODING=> PREFIX_TREE cannot be used properly

2024-03-26 Thread Wellington Chevreuil
ew feature introduced by HBASE-27329 . > > > > > > > > > > > > > > > > > > > > > > > > > > > > 在 2024-03-26 17:59:50,"Wellington Chevreuil" < > > wellington.chevre...@gmail.com> 写道: > > >PREFIX_TREE enc

Re: INDEX_BLOCK_ENCODING=> PREFIX_TREE cannot be used properly

2024-03-26 Thread Wellington Chevreuil
PREFIX_TREE encoding support has been removed in HBase 2. Please see: https://hbase.apache.org/book.html#upgrade2.0.prefix-tree.removed Em ter., 26 de mar. de 2024 às 09:39, lisoda escreveu: > HI. > > I am testing HBase version 2.5.8. I found that I can't use > INDEX_BLOCK_ENCODING=>

Re: How to do wire encryption without using kerberos.

2022-01-25 Thread Wellington Chevreuil
AFAIK, the answer is no, currently, there's no way to encrypt rpc requests if not using kerberos. There were some discussions about it in HBASE-26548 and on this slack thread .

Re: Regions per regionserver

2021-09-29 Thread Wellington Chevreuil
> > My query and interest centres around how it happens that two HBASE setups > with a big discrepancy in the number of nodes can end up with regions in > the 400-500 range. > It depends on factors like (the total size of you data / # of RSes), SplitPolicy configured (as Sergey mentioned

Re: Upgrading cdh5.16.2 to apache hbase 2.4 using replication

2021-05-20 Thread Wellington Chevreuil
Yes, replication interfaces are compatible between these two major versions. So I created two clusters in AWS and tried enable replication between HBase > 1.4.13 and 2.2.5. But have got error "table exists but descriptors are not > the same" (I will put screenshot in the attachment but not sure

Re: HBASE WALs

2021-03-23 Thread Wellington Chevreuil
due > to pending disable and stuck region. > > We may have the go-ahead to remove this table - I assume we cannot clone > it while it is in a state of (DISABLED) flux but, once again, messing with > master WALs has me on edge. > > > -Original Message- > From: Wellingt

Re: HBASE WALs

2021-03-16 Thread Wellington Chevreuil
mestamp=1613580024017, value= > > ba-hbase25.jumbo.hq.eset.com,16020,1604475904456 > > hds2_md5,BDFFEEF,1535957697205.f25fe93e24b34cb2f7fffddee1d89eec. > > column=info:state, timestamp=1613580024017, value=OPENING > > > > -Original Message- > > From:

Re: HBASE WALs

2021-03-10 Thread Wellington Chevreuil
> > Sorry if I seem stupid but this is still all new to me. > Forgot to mention, there's no stupid questions here. Don't be shy and keep'em coming. Em qua., 10 de mar. de 2021 às 09:48, Wellington Chevreuil < wellington.chevre...@gmail.com> escreveu: > However, how would that h

Re: HBASE WALs

2021-03-10 Thread Wellington Chevreuil
? HBASE master declares that table is NOT > enabled. > > Sorry if I seem stupid but this is still all new to me. > > I appreciate the help. > > -Original Message- > From: Wellington Chevreuil > Sent: Tuesday, March 9, 2021 1:20 PM > To: Hbase-User >

Re: HBASE WALs

2021-03-09 Thread Wellington Chevreuil
HBASE and JDK here is the same version so if it > worked fixing one cluster HBASE then it should work for other installs. > > Fiddling with masterprocWALs will require complete shutdown of hbase > operations to prevent incoming reds/writes on other tables and I am not > sure how dis

Re: HBCK2 Tools

2021-03-09 Thread Wellington Chevreuil
There are three modules on hbase-operator-tools: - hbase-hbck2: I believe most of the hbck2 commands, apart from assigns/unassigns, wouldn't require tables to be enabled. - hbase-tools: RegionsMerger would require table to be enabled. MissingRegionDirsRepairTool doesn't require tables to be

Re: HBASE WALs

2021-03-02 Thread Wellington Chevreuil
creveu: > If you know of anything that will help I would appreciate it. > > If you need any log output let me know. > > Thanks > > > -Original Message- > From: Wellington Chevreuil > Sent: Thursday, February 25, 2021 4:08 PM > To: Hbase-User > Subject: Re

Re: HBASE WALs

2021-02-25 Thread Wellington Chevreuil
> > Do WAL files contain information for multiple regions per WAL or is one > WAL associated with one region? > Multiple regions edits would be present in a single wal file. That's why upon a RS crash and wal processing, there's a wal split phase. I am trying to find a way to clear a RIT for a

Re: Removal of table rows.

2020-12-18 Thread Wellington Chevreuil
what other operations are carried out other than > removing meta rows? Eg., is zookeeper shell called to deal with any > outstanding items? I saw zk information on screen when I ran tools. > > -Original Message- > From: Wellington Chevreuil > Sent: Thursday, December

Re: Removal of table rows.

2020-12-17 Thread Wellington Chevreuil
on master(s) so I was surprised to see a > lingering row. > > > > -Original Message- > > From: Wellington Chevreuil > > Sent: Thursday, December 17, 2020 1:34 PM > > To: Hbase-User > > Subject: Re: Removal of table rows. > > > > EXTERNAL

Re: Removal of table rows.

2020-12-17 Thread Wellington Chevreuil
HBASE on the master still shows the 48 regions in transition when I open > the interface. I assume this is because the service has not been restarted. > > M > > -Original Message- > From: Wellington Chevreuil > Sent: Wednesday, December 16, 2020 3:39 PM > To: Hbase

Re: Removal of table rows.

2020-12-16 Thread Wellington Chevreuil
have been informed > we have 'maven' installed on one host on a cluster, which is centos and > (probably) a different java, and the build itself is needed for Ubuntu16. > > -Original Message- > From: Wellington Chevreuil > Sent: Wednesday, December 16, 2020 10:08 AM &g

Re: Removal of table rows.

2020-12-16 Thread Wellington Chevreuil
Region Server > Read RequestsWrite Requests > Num.Storefiles MemSize Locality > hbase:meta,,1.1588230740ba-wtmp05.asgardalfa.hq.com:16030 > 219,168,603 35,419 1 MB 4 0 B >

Re: Removal of table rows.

2020-12-15 Thread Wellington Chevreuil
> > I am an HBASE newbie so I apologise if I am being repetitious. > > Apologies also if this is not the right group. Am not sure if this may be > more suited to 'dev' list. > Welcome, this is the right channel for this kind of questions. > The solution offered by hbase-operator-tools -

Re: [ANNOUNCE] New HBase committer Yulin Niu

2020-12-03 Thread Wellington Chevreuil
Congratulations! Em qui., 3 de dez. de 2020 às 14:56, zheng wang <18031...@qq.com> escreveu: > Congratulations! > > > > > --原始邮件-- > 发件人: > "user" > <

Re: [ANNOUNCE] New HBase committer Xin Sun

2020-12-03 Thread Wellington Chevreuil
Congratulations and welcome! Em qui., 3 de dez. de 2020 às 09:13, Guanghao Zhang escreveu: > Folks, > > On behalf of the Apache HBase PMC I am pleased to announce that Xin Sun has > accepted the PMC's invitation to become a committer on the project. > > We appreciate all of the great

Re: Ghost Regions Problem

2020-08-05 Thread Wellington Chevreuil
ions from > clean hbase:meta table. Does a rolling restart of all masters do that or do > I have to shut all masters down to force them to proceed with > initialization on startup? > > Wellington Chevreuil , 4 Ağu 2020 Sal, > 16:42 tarihinde şunu yazdı: > > > > &

Re: Ghost Regions Problem

2020-08-04 Thread Wellington Chevreuil
> > if you use hbck2 to bypass > those locks but leave them as they are, it would be only a cosmetic move, > regions won't become online in real > You can use hbck2 *assigns *method to bring those regions online (it accepts multiple regions as input) i've read that master processes have some

Re: Violating strong consistency after the fact

2020-07-03 Thread Wellington Chevreuil
sting, I wasn't aware of this. Are there any docs you could > > > point me towards where this is described? I've had a look in Hadoop: > > > The Definitive Guide and the official docs, but hadn't come across > > > this. > > > > > > On Fri, Jul 3, 2020 at

Re: Violating strong consistency after the fact

2020-07-03 Thread Wellington Chevreuil
This is actually an hdfs consistency question, not hbase. If the hdfs write succeeded while u had only one DN available, then the other replica on the offline DN would be invalid now. Then what u have is an under replicated block, and of your only available DN goes offline before it could be

Re: [DISCUSS] Normalizer and pre-split tables

2020-06-29 Thread Wellington Chevreuil
; hbase.normalizer.merge.min_region_size.mb to 0? Do I risk blowing away > > regions from pre-splits or something? > > > > Yes, the idea was to guard against merging away intentional pre-splits. > > On Mon, Jun 29, 2020 at 2:42 AM Wellington Chevreuil < > > wellington

Re: [DISCUSS] Normalizer and pre-split tables

2020-06-29 Thread Wellington Chevreuil
> > The trouble is we ship defaults for all of the `*min*` configs, and right > now there's no way to "unset" them, disable the functionality. Which means > there still isn't a way to support the empty regions use-case without > awkward special-case checks. > HBASE-23562 added a RegionsMerger

Re: hbck2 doesn't support fixing region holes

2020-05-28 Thread Wellington Chevreuil
The risks are high, there is currently no plans to add those to hbck2. HBCK2 does provide many methods that can be used in conjunction to fix region holes. This is inline with the current *philosophy *for hbck2, where repairs should be iteratively by operators. Depending on the nature of your

Re: [ANNOUNCE] New HBase committer Wei-Chiu Chuang

2020-05-14 Thread Wellington Chevreuil
Congratulations, Wei-Chiu! Welcome! Em qui., 14 de mai. de 2020 às 10:12, Jan Hentschel < jan.hentsc...@ultratendency.com> escreveu: > Congratulations Wei-Chiu and welcome! > > From: Sean Busbey > Reply-To: "d...@hbase.apache.org" > Date: Wednesday, May 13, 2020 at 9:10 PM > To: dev ,

Re: How to delete row with Long.MAX_VALUE timestamp

2020-05-13 Thread Wellington Chevreuil
Table is ~ 10TB SNAPPY data. I don’t have such a big time window on > > production for re-inserting all data. > > > > I don’t know how we got those cells. I can only assume that this is > > phoenix and/or replaying from WAL after region server crash. > > > > >

Re: How to delete row with Long.MAX_VALUE timestamp

2020-05-12 Thread Wellington Chevreuil
COLUMN+CELL > > \x0439d58wj434dd column=d:, > timestamp=1588269277879, type=DeleteFamily > > > > > >> On 29 Apr 2020, at 18:30, Wellington Chevreuil < > wellington.chevre...@gmail.com <mailt

Re: how to scan for all values which don't have given timestamps?

2020-05-11 Thread Wellington Chevreuil
I don;t think there's any built-in filter for that. You would need to implement your own filter with this logic. Em sáb., 9 de mai. de 2020 às 21:56, Vitaliy Semochkin escreveu: > Hello everyone, > > Hi, I need to scan for all values which don't have given timestamps? > > Does anyone know how

Re: How to delete row with Long.MAX_VALUE timestamp

2020-04-29 Thread Wellington Chevreuil
Alexander Batyrshin <0x62...@gmail.com>님이 작성: > > > As you can see in example I already tried DELETE operation with timestamp > > = Long.MAX_VALUE without any success. > > > > > On 29 Apr 2020, at 12:41, Wellington Chevreuil < > > wellington.chevre...@g

Re: How to delete row with Long.MAX_VALUE timestamp

2020-04-29 Thread Wellington Chevreuil
That's expected behaviour [1]. If you are "travelling to the future", you need to do a delete specifying Long.MAX_VALUE timestamp as the timestamp optional parameter in the delete operation [2], if you don't specify timestamp on the delete, it will assume current time for the delete marker, which

Re: How to use Pluggable RPC authentication

2020-04-27 Thread Wellington Chevreuil
> > how to use or config the custom authentication ? > Assuming your authentication solution implements properly the key interfaces *SaslServerAuthenticationProvider*, *SaslClientAuthenticationProvider* and *BuiltInProviderSelector*, you need to specify each of these implementations on the

Re: Empty REGIONINFO after Region Server Restart

2020-04-22 Thread Wellington Chevreuil
> > I am running HBase 1.4.10 on AWS EMR 5.29.0 > Which file system is hbase root dir under? If it's S3, it's very likely some of its lack of consistency issues leading to missing regioninfo files. Em qua., 22 de abr. de 2020 às 02:21, Stack escreveu: > On Mon, Apr 20, 2020 at 7:59 AM Mike

Re: region not found on an online server, hbase 2.1.4, hadoop 3.1.2

2020-02-07 Thread Wellington Chevreuil
Hi Michael, That indicates some inconsistency in your hbase:meta, where that region info is not up to date, showing the region online on a region server (RS) instance that doesn't exist anymore (the 1580999341692 indicates the timestamp of when that RS instance was started. Everytime you restart

Re: [ANNOUNCE] New HBase committer Bharath Vissapragada

2020-02-06 Thread Wellington Chevreuil
Congratulations and welcome to the team, Bharath! Em qui., 6 de fev. de 2020 às 19:25, Esteban Gutierrez escreveu: > Yay! Congratulations Bharath! > > esteban. > -- > Cloudera, Inc. > > > > On Thu, Feb 6, 2020 at 12:07 PM Andrew Purtell > wrote: > > > Congratulations and welcome, Bharath! > >

Re: data replication if cluster replication is enabled later

2020-01-20 Thread Wellington Chevreuil
Data will be targeted to replication only once you have a replication peer added and your related table column family REPLICATION_SCOPE is set to '1'. If you had your table column family REPLICATION_SCOPE set to '1', but no replication peer added, then no data inserted/modified prior to having a

Re: Any issues, if we enable table level replication when cluster replication is disabled

2020-01-20 Thread Wellington Chevreuil
If you are planning to enable it using 'alter' command or java admin API, no issues, replication will not be initiated until you add a replication peer. If you try to do it using hbase shell "enable_table_replication" command, the command will fail. Em seg., 20 de jan. de 2020 às 00:00, sudhir

Re: [ANNOUNCE] New HBase committer Viraj Jasani

2019-12-27 Thread Wellington Chevreuil
Congratulations, Viraj! Welcome aboard! Em sex., 27 de dez. de 2019 às 13:02, Peter Somogyi escreveu: > On behalf of the Apache HBase PMC I am pleased to announce that > Viraj Jasani has accepted the PMC's invitation to become a > commiter on the project. > > Thanks so much for the work you've

Re: [ANNOUNCE] Please welcome Guangxu Cheng the HBase PMC

2019-12-09 Thread Wellington Chevreuil
Congratulations Guangxu! Em seg., 9 de dez. de 2019 às 10:08, Balazs Meszaros escreveu: > Congratulations and welcome Guangxu! > > On Mon, Dec 9, 2019 at 10:51 AM 宾莉金(binlijin) wrote: > > > Congratulations! > > > > Duo Zhang 于2019年12月9日周一 下午5:47写道: > > > > > On behalf of the Apache HBase PMC

Re: Deleting a (contiguous) subset of the columns in a row

2019-11-11 Thread Wellington Chevreuil
I don't think you would have an easier way to do this without having to redefine your table layout, so that you split these two groups into separate column families, and apply this "classification" logic at insertion time to determine which column family a given cell should go. Another

Re: Completing a bulk load from HFiles stored in S3

2019-11-01 Thread Wellington Chevreuil
gt; [1] > > https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/filesystem/filesystem.html#boolean_rename.28Path_src.2C_Path_d.29 > > On 10/31/19 6:55 AM, Wellington Chevreuil wrote: > > I believe you can specify your s3 path for the hfiles directly, as hdf

Re: Completing a bulk load from HFiles stored in S3

2019-10-31 Thread Wellington Chevreuil
I believe you can specify your s3 path for the hfiles directly, as hdfs FileSystem does support s3a scheme, but you would need to add your s3 access and secret key to your completebulkload configuration. Em qua, 30 de out de 2019 às 19:43, Gautham Acharya < gauth...@alleninstitute.org> escreveu:

Re: [ANNOUNCE] Please welcome Wellington Chevreuil to the Apache HBase PMC

2019-10-24 Thread Wellington Chevreuil
a (BLOOMBERG/ 731 LEX) > Sent: 24 October 2019 04:19 > To: d...@hbase.apache.org > Cc: user@hbase.apache.org > Subject: Re: [ANNOUNCE] Please welcome Wellington Chevreuil to the Apache > HBase PMC > > Congrats Sakthi and Wellington! > > From: d...@hbase.apache.org At: 10/

Re: [ANNOUNCE] Please welcome Sakthi to the Apache HBase PMC

2019-10-24 Thread Wellington Chevreuil
Congratulations, Sakthi! Em qui, 24 de out de 2019 às 12:38, Reid Chan escreveu: > Welcome Sakthi! Congratulations! > > > -- > > Best regards, > R.C > > > > > From: Sean Busbey > Sent: 24 October 2019 04:14 > To: dev; Hbase-User

Re: [ANNOUNCE] Please welcome Balazs Meszaros to the Apache HBase PMC

2019-10-24 Thread Wellington Chevreuil
Congratulations, Balazs! Em qui, 24 de out de 2019 às 15:34, Sean Busbey escreveu: > On behalf of the Apache HBase PMC I am pleased to announce that > Balazs Meszaros has accepted our invitation to become a PMC member on the > HBase project. We appreciate Balazs stepping up to take more >

Re: zookeeper - cluster redirection not happening

2019-08-22 Thread Wellington Chevreuil
:2181,server2:2181,server3:2181 > > > > > This is what I see in hbase-site.xml > > > > ha.zookeeper.quorum > > server1:2181,server2:2181,server3:2181 > > > > > > > On Thu, Aug 22, 2019 at 5:21 PM Wellington Chevreuil < > wellington.chev

Re: zookeeper - cluster redirection not happening

2019-08-22 Thread Wellington Chevreuil
The shared log snippet mentions a single server in the quorum connection string: 16:38:12,838 ERROR [org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher] > (default task-27) hconnection-0x2f95012, quorum=zookeeper1:2181 > , baseZNode=/hbase >

Re: [ANNOUNCE] New HBase committer Tak-Lon (Stephen) Wu

2019-08-06 Thread Wellington Chevreuil
Congratulations Stephen! Em ter, 6 de ago de 2019 às 10:32, Anoop John escreveu: > Congratulations Stephen. > > -Anoop- > > > On Tue, Aug 6, 2019 at 11:19 AM Pankaj kr wrote: > > > Congratulations Stephen..!! > > > > Regards, > > Pankaj > > > > -Original Message- > > From: Sean

Re: [ANNOUNCE] new HBase committer Sakthi

2019-08-01 Thread Wellington Chevreuil
Congratulations, well deserved!! Em qui, 1 de ago de 2019 às 10:17, Szalay-Beko Mate escreveu: > Congratulations!! :) > > On Thu, Aug 1, 2019 at 9:56 AM kevin su wrote: > > > Congratulations  > > > > OpenInx 於 2019年8月1日 週四,下午3:17寫道: > > > > > Congratulations, Sakthi. > > > > > > On Thu, Aug

Re: Failed to create assembly

2019-07-15 Thread Wellington Chevreuil
Do you need all these extra maven params? If all you want is to build a tar ball, have you tried below? $ mvn package assembly:single -DskipTests Em seg, 15 de jul de 2019 às 10:33, Kang Minwoo escreveu: > I forgot to attach the build command. > I try to build HBase 2.1.5 using below command.

Re: replication - how to change peer cluster key (zookeeper)

2019-07-11 Thread Wellington Chevreuil
Hi Marjana, I guess OpenInx (much valid) point here is that between step#2 and #3, you need to make sure there's no lags for ORIGINAL_PEER_ID, because if it has huge lags, it might be that some of the edits pending on its queue came before you added NEW_PEER_ID in step #1. In that case, since

Re: replication - how to change peer cluster key (zookeeper)

2019-07-10 Thread Wellington Chevreuil
Yep, that's a better, concise description of what I meant. You could even do #2 after #4, doesn't really matter, as long source cluster is already trying to replicate to the new peer id. Em qua, 10 de jul de 2019 às 13:03, marjana escreveu: > You were thinking something like: > > 1. add_peer

Re: replication - how to change peer cluster key (zookeeper)

2019-07-09 Thread Wellington Chevreuil
How about adding it as a new peer, where you define a new peerID for the new ZK quorum? Until your new ZK quorum address is effective, replication would accumulate edits, then once you complete the ZK move, it will resume replication to that one, and original peer id could be removed. Em ter, 9

Re: Merged daughter region

2019-07-05 Thread Wellington Chevreuil
Hi Austin, which hbase version is in use? Is this '7b0d3c6836cf417b007771ab48d0450f' the parent region, or one of the daughter regions that got merged? What does meta scan show for the parent region and original two daughters, plus the resulting region from the merge? Em sex, 5 de jul de 2019 às

Re: TableSnapshotInputFormat failing to delete files under recovered.edits

2019-06-18 Thread Wellington Chevreuil
base code. The potential data > loss is what I'm wondering about - would data loss have occurred if we > happened to execute our job under a user that had delete permissions in > HDFS directories? Or did the edits actually get replayed when regions were > in stuck and transition and the file

Re: TableSnapshotInputFormat failing to delete files under recovered.edits

2019-06-17 Thread Wellington Chevreuil
It seems the mentioned "hiccup" caused RS(es) crash(es), as you got RITs and recovered edits under these regions dirs. The fact there was a "recovered" dir under some regions dirs means that when the snapshot was taken, crashed RS(es) WAL(s) had been split, but not completely replayed yet. Since

[ANNOUNCE] HBase FileSystem 1.0.0-alpha1 is now available for download

2019-06-13 Thread Wellington Chevreuil
The HBase team is happy to announce the immediate availability of Apache HBase FileSystem 1.0.0-alpha1. Apache HBase FileSystem provides additional Apache Hadoop's FileSystem interface implementation, in order to enforce HBase expected FileSystem semantics on top of object-store implementations

Re: [ANNOUNCE] New Committer: Wellington Chevreuil

2019-06-08 Thread Wellington Chevreuil
purt...@gmail.com > > > > > > wrote: > > > > > > > Congratulations and welcome, Wellington. > > > > > > > > > On Jun 7, 2019, at 3:11 AM, Peter Somogyi > > wrote: > > > > > > > > > > On behalf of the HBase

Re: How does HBase deal with master switch?

2019-06-06 Thread Wellington Chevreuil
Hey Zili, Besides what Duo explained previously, just clarifying on some concepts to your previous description: 1) RegionServer started full gc and timeout on ZooKeeper. Thus ZooKeeper > regarded it as failed. > ZK just knows about sessions and clients, not the type of client connecting to it.

Re: Difference of n columns with 1 version vs 1 column with n versions

2019-03-31 Thread Wellington Chevreuil
I would agree with JMS, to ideally avoid wide tables. Plus, there are still some inconsistent behaviour for versions feature (See HBASE-21596, for example). I would also favour option "a" over "b", as it seems to give more flexibility in the way you can access/delete these columns. Em dom, 31 de

Re: Region flush delayed even memstore size above MEMSTORE_FLUSH config.

2019-03-11 Thread Wellington Chevreuil
Well, there would be already a flush request for the region in the queue anyway, and this would force flush of all stores, so doesn't look adding an additional request would have any benefit, does it? Em seg, 11 de mar de 2019 às 04:22, Kang Minwoo escreveu: > Hello Users. > > --- > HBase

Re: HBase Coprocessor calls fail with RegionNotFoundException during region splits

2019-02-19 Thread Wellington Chevreuil
The client RPC properties are not hardcoded, "pause" is defined by "hbase.client.pause" and for number of retries, there is "hbase.client.retries.number". Since the attempted region got split and will never be online again, maybe you can decrease these properties on your coprocessor code to "fail

Re: Throttle major compaction for version 1.1.2

2019-01-23 Thread Wellington Chevreuil
I can see in branch 1.1 that CompactSplitThread does load a CompactionThroughputController here [1], and it's possible to set PressureAwareCompactionThroughputController [2] on "hbase.regionserver.throughput.controller" property. PressureAwareCompactionThroughputController defines additional

Re: how do disable encryption on a CF

2019-01-23 Thread Wellington Chevreuil
I believe this is a limitation from hbase shell, where it provides no means to set a null value for a column family property. An alternative would be to use Java Client API, below a code example: Configuration configuration = HBaseConfiguration.create(); try(Connection connection =

Re: tables in archive directory

2019-01-22 Thread Wellington Chevreuil
No, u can't manually delete files from archive folder. Hbase would remove those automatically once it doesn't need it anymore. The fact those files are still there means those are probably still referenced by snapshots or cloned tables. On Tue, 22 Jan 2019, 16:44 Munoz, Robert Hello, > > I am

Re: coprocessor and hbase.regionserver.handler.count

2019-01-21 Thread Wellington Chevreuil
> > I am not familiar with thread-dumping or profiler. Is there any reference > that I can study about how to use those tools to analyze this kind of issue? You can start collecting jstack [1] frames of the RS process while your test is running. Jstack command dumps state of all threads from the

Re: HBase top activity

2019-01-09 Thread Wellington Chevreuil
I don't think it is possible to track individual scans resources usage, current available JMX metrics are an aggregation of all request types (scanNext, append, get, delete) per regions level at individual RSes, and these are basically counts on the number of those requests. Resources usage are

Re: Getting old value for the cell after TTL expiry of latest value cell value set with TTL.

2018-12-20 Thread Wellington Chevreuil
I believe this is the same issue as when deleting with specific timestamp (HBASE-21596). The scanner triggered during flush will let the 1st version go through because it's still the only version at that time. The second flush will make the second version (with TTL) to also go through. TTL

Re: hadoop hdfs ha QJM namenode failover causes dead regionservers (IOE in log roller) , master server abort, and needed hbck -fixAssignments

2015-12-15 Thread Wellington Chevreuil
Hi Solin, The timeout messages are usually a consequence of other issues on the connectivity between the Namenode and the QJM. Assuming Regionservers are configured properly to HDFS HA, pointing to an HDFS nameservice instead of a direct namenode address, it should also be resilient to a

Re: I can't start cluster due to zookeeper

2015-04-27 Thread Wellington Chevreuil
Hi, Have you checked if your ZK quorum is properly running, before trying to start HBase? Also, the hostnames defined for ZK quorum nodes seem quite unusual. Shouldn't these be as follows? property namehbase.zookeeper.quorum/name

Re: write availability

2015-04-07 Thread Wellington Chevreuil
When a RS goes down, the Master will try to assign the regions on the remaining RSes. When the RS comes back, after a while, the Master balancer process will re-distribute regions between RS, so the given RS will be hosting regions, but not necessarily the one it used to host before it went

Re: HMaster does not start when Upgrading Hbase 0.94 to 0.98 (needed by new version of Drill)

2015-02-14 Thread Wellington Chevreuil
Hi, It seems there's already a process using zookeeper port, which is preventing zookeeper from start properly. Does netstat -nalp | grep 2181 return any result? On 13 Feb 2015, at 21:31, Alexander Zarei alexanderz.si...@gmail.com wrote: Hi, I was wondering if you could help me solve

Re: Access hbase remotely from java client

2014-09-29 Thread Wellington Chevreuil
Hi, You should not do this, as localhost should resolve to the own host. This is probably some missing property on the clients hbase configuration (make sure you have a proper hbase-site.xml on client's classpath or set configuration programatically). As a start, check if you had set the

Re: How to monitor HBase Region Server ?

2014-07-24 Thread Wellington Chevreuil
The master and region servers UI on hbase 0.98 provide all these details. You can access your master UI and from there navigate through your RS for specific details. http://YOUR-MASTER-HOST:60010/ On 24 Jul 2014, at 12:12, Pham Phuong Tu tuphamphu...@gmail.com wrote: Hi guys, I want to

Re: Replication in Hbase

2014-07-22 Thread Wellington Chevreuil
I think you need to run a ZK instance apart from HBase. But if your main goal is to copy data from one cluster to another, you may use other options, such as CopyTable, Bulkload, or Export/Import tools. Replication will not copy data already inserted previously on your source Hbase, it only

Re: Copy data from one cluster to another cluster on different lan

2014-07-17 Thread Wellington Chevreuil
Hi, If you r planning to copy hbase data between your clusters, you may find the CopyTable and Export/Import tools described in the book: http://hbase.apache.org/book/ops_mgt.html#tools If running hbase 0.94.6 onwards, there is also the option to use snapshots:

Re: HBase table is in LIMBO its neither Enabled Nor Disabled !!

2014-07-14 Thread Wellington Chevreuil
Hi Vikram, You may be facing this issue: https://issues.apache.org/jira/browse/HBASE-6469 Have you already tried to restart your HMaster, as suggested in this jira? Thanks, Wellington. On 14 Jul 2014, at 10:32, Vikram Singh Chandel vikramsinghchan...@gmail.com wrote: Hi Cluster size :

Re: HBase Master cannot be contacted by Region Servers

2014-07-09 Thread Wellington Chevreuil
Hi, Had you already tried to set the port on hbase.rootdir for hbase-site.xml, like below: property namehbase.rootdir/name valuehdfs://master:8020/hbase/value /property Cheers. On 9 Jul 2014, at 14:18, Cosmin Cătălin Sanda cosmincata...@gmail.com wrote: I have a Hadoop

Re: HBase Master cannot be contacted by Region Servers

2014-07-09 Thread Wellington Chevreuil
I guess you also may need to set the zookeeper client port, on your hbase-site: property namehbase.zookeeper.property.clientPort/name value2181/value /property On 9 Jul 2014, at 14:18, Cosmin Cătălin Sanda cosmincata...@gmail.com wrote: I have a Hadoop cluster made of 3 slaves and

Re: Store data in HBase with a MapReduce.

2014-06-26 Thread Wellington Chevreuil
Hi Guillermo, You can use the TableOutputFormat as the output format for your job, then on your reduce, you just need to write Put objects. On your driver: Job job = new Job(conf); … job.setOutputFormatClass(TableOutputFormatClass); job.setReducerClass(AverageReducer.class);

Re: No of column qualifiers in a column family

2014-06-15 Thread Wellington Chevreuil
Hi Vimal, Adding to Dima's comment, just be aware about how large your rows will become in bytes, with so much cqs. If you end up with a row larger than the configured size limit for regions, regionserver will have problems to split the region. Also, if your schema is defined by very wide rows,

Re: high load average in one region server

2014-06-13 Thread Wellington Chevreuil
Might be worth check hbase ui (http://hbase-host:60010/), you will see a page where there is a table “Region Servers”, and you can check there if regions are evenly spread around your RS. From there, you can click on the link for each of your RS, and you can find more information specific for

Re: HBase and HDFS HA failover with QJM

2014-06-08 Thread Wellington Chevreuil
Hi Jerry, There's no need for additional HBase configuration when using HDFS HA, as it works as an HDFS client and RS will reach NN through nameservice configured on hdfs-site, and once both active and standby NNs have an up to date image of HDFS state, during a failover the transition between