NOTICE: Pushed a blog post on turning Short-Circuit Reads in HBase

https://blogs.apache.org/hbase/entry/an-hbase-hdfs-short-circuit Yours, Huaxiang and Stack

Re: Hbase export is very slow - help needed

Can you host your images elsewhere and instead add links here only? Our mailing list doesn't allow images inline. Is the export distributed or running in series? Does upping logging levels tell you where time is spent (or thread dumping the export task?) Thanks, S On Fri, Aug 6, 2021 at 7:53 AM

[ANNOUNCE] Apache HBase 2.3.6 is now available for download

The HBase team is happy to announce the immediate availability of HBase 2.3.6. Apache HBase™ is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized hardware. To learn

Re: [ANNOUNCE] New HBase PMC Bharath Vissapragada

Good on you B. S On Fri, Jul 30, 2021 at 6:26 AM Viraj Jasani wrote: > On behalf of the Apache HBase PMC I am pleased to announce that Bharath > Vissapragada has accepted our invitation to become a PMC member on the > HBase project. We appreciate Bharath stepping up to take more >

Re: [ANNOUNCE] New HBase Committer Xiaolin Ha(哈晓琳)

Welcome Xiaolin Ha! S On Sat, May 15, 2021 at 3:10 PM 张铎(Duo Zhang) wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that Xiaolin > Ha(sunhelly) has accepted the PMC's invitation to become a committer on the > project. We appreciate all of Xiaolin's generous contributions

Re: [SURVEY] The current usage of favor node balancer across the community

On Mon, Apr 26, 2021 at 7:30 PM Mallikarjun wrote: > Inline reply > > On Tue, Apr 27, 2021 at 1:03 AM Stack wrote: > > > On Mon, Apr 26, 2021 at 12:30 PM Stack wrote: > > > > > On Mon, Apr 26, 2021 at 8:10 AM Mallikarjun > > > wrote: > >

Re: [SURVEY] The current usage of favor node balancer across the community

On Mon, Apr 26, 2021 at 12:30 PM Stack wrote: > On Mon, Apr 26, 2021 at 8:10 AM Mallikarjun > wrote: > >> We use FavoredStochasticBalancer, which by description says the same thing >> as FavoredNodeLoadBalancer. Ignoring that fact, problem appears to be >> >>

Re: [SURVEY] The current usage of favor node balancer across the community

Duo Zhang) > wrote: > > > As you all know, we always want to reduce the size of the hbase-server > > module. This time we want to separate the balancer related code to > another > > sub module. > > > > The design doc: > > > > > https://docs.

Re: HBASE WALs

on your wals. But please be aware that what you really > > need here to get rid of the rogue proc is to remove master proc wals, > not normal wals. > > > > Em ter., 16 de mar. de 2021 às 07:12, Marc Hoppins > > > > escreveu: > > > > > Overall, I am

Re: EOL branch-1 and all 1.x ?

Thanks for the write-up Andrew. +1 on its EOL'ing. S On Wed, Mar 31, 2021 at 3:03 PM Andrew Purtell wrote: > Is it time to consider EOL of branch-1 and all 1.x releases ? > > There doesn't seem to be much developer interest in branch-1 beyond > occasional maintenance. This is understandable.

Re: [DISCUSS] Updating the 'stable' pointer to 2.4.2

es not meet that requirement, because this depends on third > party organizations (a dev's employer, and such) and idiosyncratic > criteria. > > That's fair. It would be better if we spec'd what a 'stable release' is and then ran candidates through the hoops. S > > > On Mar 18, 2021

Re: [DISCUSS] Updating the 'stable' pointer to 2.4.2

On Thu, Mar 18, 2021 at 11:55 AM Andrew Purtell wrote: > And how would we know we have one? We don't track usage telemetry. > > Someone of us w/ standing volunteers that they have made the move (was what I was thinking). S > > > On Mar 18, 2021, at 11:29 AM, Stack wrot

Re: [DISCUSS] Updating the 'stable' pointer to 2.4.2

On Wed, Mar 17, 2021 at 1:49 PM Andrew Purtell wrote: > I would like to propose we update the 'stable' release pointer, currently > pointing at 2.3.4, to 2.4.2. > > In my testing with aggressive chaos and ITBLL (but in, unfortunately, due > to resource constraints, in small cluster settings of

Re: HBASE WALs

On Fri, Mar 12, 2021 at 2:17 AM Marc Hoppins wrote: > Hi, all, > > For our stuck region, this exists in meta. Could we alter the state to > CLOSED (maybe via intermediate OPEN, CLOSING, CLOSED)? > > You could but IIRC, in that version of HBase, you may need to restart the Master after the

Re: Region server idle

Looking at code around exception, can you check your quota settings? See refguide on how to list quotas. Look for table or namespace that is empty or non-existant and fill in missing portion. This is master-side log? It is from a periodic task so perhaps something else is in the way of the

Re: Region server idle

The balancer is running Mark? You can check the Master log file. See what it says about balancer. Balancer won't run if there regions stuck in transition; perhaps some such thing is happening here? S On Thu, Jan 7, 2021 at 3:28 AM Marc Hoppins wrote: > Sorry, I forgot to point out that

Re: Removal of table rows.

On Tue, Dec 15, 2020 at 7:46 AM Marc Hoppins wrote: > Hi all, > > I am an HBASE newbie so I apologise if I am being repetitious. > > Apologies also if this is not the right group. Am not sure if this may be > more suited to 'dev' list. However, > > A problem question and a technical/wishlist

Re: [ANNOUNCE] New HBase committer Xin Sun

Welcome Xin Sun! S On Thu, Dec 3, 2020 at 1:13 AM Guanghao Zhang wrote: > Folks, > > On behalf of the Apache HBase PMC I am pleased to announce that Xin Sun has > accepted the PMC's invitation to become a committer on the project. > > We appreciate all of the great contributions Xin Sun has

Re: [ANNOUNCE] New HBase committer Yulin Niu

Hurray! Congrats Yulin! S On Thu, Dec 3, 2020 at 1:11 AM Guanghao Zhang wrote: > Folks, > > On behalf of the Apache HBase PMC I am pleased to announce that Yulin Niu > has accepted the PMC's invitation to become a committer on the project. > > We appreciate all of the great contributions Yulin

Re: Hbase 2.2.5 Unable to load .regioninfo from table

On Thu, Sep 24, 2020 at 3:32 AM Martin Braun wrote: > Hello all, > > i digged a bit deeper into this: > > the WALPlayer is not able to replay recovered.edits files, the source code > http://hbase.apache.org/2.2/devapidocs/src-html/org/apache/hadoop/hbase/mapreduce/WALInputFormat.html > > seems

Re: Fixing Catalog Janitor and HBCK chore reported inconsistencies automatically

nks > -Arshad > > -Original Message- > From: Stack [mailto:st...@duboce.net] > Sent: Tuesday, August 18, 2020 9:20 AM > To: Hbase-User > Cc: d...@hbase.apache.org > Subject: Re: Fixing Catalog Janitor and HBCK chore reported > inconsistencies automatically >

Re: Fixing Catalog Janitor and HBCK chore reported inconsistencies automatically

On Thu, Aug 6, 2020 at 10:10 PM Mohammad arshad wrote: > Hello HBase Folks > > Currently Catalog Janitor (CJ) and HBCK chore reported inconsistencies to > be fixed by manually by executing HBCK2 commands. > HBCK2 requires high HBase skills. It is bit difficult for maintenance > personals to

Re: Is HBase WAL replication from cluster with HBase 1.1.2 to cluster with HBase 2.0.2 supported ?

Replication from hbase1 to hbase2 works. Your issue looks to be HBASE-24354 It is fixed in 2.3.0+ only. S On Fri, Jul 17, 2020 at 8:11 AM Vinu Raj wrote: > Is HBase WAL replication from cluster with HBase 1.1.2 to cluster with > HBase 2.0.2 supported ? Tried a simple test where following

Re: JMX Issues

On Mon, Jun 29, 2020 at 11:07 AM Govindhan S wrote: > I got this figured out and solved. > Issue with the AMSà Advanced AMS-hbase-env-template à optional_cp (given > below) > Had extra : present with wrong Jar file, hence the issue. Correcting the > same cleared me. > Thanks everyone. > ~

Re: JMX Issues

Can you figure which key it is? This seems common enough issue grepping the web. There is even an old complaint in hbase JIRA that was resolved long ago. It is likely fixed in later versions. You are running an old version. Can you upgrade? Thanks, S On Fri, Jun 26, 2020 at 10:14 AM Govindhan S

Re: [DISCUSS] Removing problematic terms from our project

+1/+1/+1/+1 where hbase3 adds the deprecation and hbase4 follows hbase3 soon after sounds good to me. I'm up for working on this. S On Wed, Jun 24, 2020 at 2:26 PM Xu Cang wrote: > Strongly agree with what Nick said here: > > " From my perspective, we gain nothing as a project or as a

Re: On org.apache.hadoop.hbase.constraint

HTableDescriptor on master branch, I found that it > has > > > been > > > > > referenced by org.apache.hadoop.hbase.constraint package. > > > > > > > > > > The problem here is that, the API design is to pass in an > > > > HTableDescriptor > > > > >

Re: [ANNOUNCE] Please welcome Lijin Bin to the HBase PMC

Hurray for Lijin Bin! S On Mon, May 25, 2020 at 6:33 PM 宾莉金（binlijin） wrote: > Thanks everybody. It’s an honor to join the PMC and I’ll try to do my best > to help the project and the community. > > Jan Hentschel 于2020年5月26日周二 上午1:37写道： > > > Congratulations and welcome! > > > > From: Guanghao

Re: Celebrating our 10th birthday for Apache HBase

Nice testimonial above Mich. S On Sun, May 3, 2020 at 3:45 AM Mich Talebzadeh wrote: > Hi, > > Back in 2017, I wrote an article in LinkedIn on HBase titled HBase for > impatient > > > Today I wrote a post in

Re: DISCUSS: Move hbase-thrift and hbase-rest out of core to hbase-connectors project?

release first that packages thrift/rest. At move time, let me mess w/ the suggestions below of shedding dependencies on the likes of YARN and of updating REST to (shaded?) jersey2, etc. Thanks, S On Fri, Apr 24, 2020 at 2:33 PM Stack wrote: > Taking a sounding > > We've talked

Re: DISCUSS: Move hbase-thrift and hbase-rest out of core to hbase-connectors project?

ces > directly from the download? > > Former. Not the latter. They would no-longer be part of the hbase-2.3.x distribution. S > On Fri, Apr 24, 2020, 16:34 Stack wrote: > > > Taking a sounding > > > > We've talked of moving the hbase-rest and hbase-thrif

DISCUSS: Move hbase-thrift and hbase-rest out of core to hbase-connectors project?

Taking a sounding We've talked of moving the hbase-rest and hbase-thrift modules out of core over to hbase-connectors project [2, 3]. The connectors project [1] was meant for the likes of REST and thrift. I'm thinking of trying to do the move in the next few days BEFORE 2.3.0RC0. Any

Re: Empty REGIONINFO after Region Server Restart

On Mon, Apr 20, 2020 at 7:59 AM Mike Linsinbigler wrote: > Hello, > > I am running HBase 1.4.10 on AWS EMR 5.29.0 and have had issues after > some of our Region Servers restart (due to a variety of reasons) and the > cluster enters an inconsistent state after they come back up. > > Running hbck,

Re: Clarification for WAL Compression doc

On Tue, Apr 14, 2020 at 1:16 PM Andrey Elenskiy wrote: > Hello, > > I'm trying to understand the extent of the following issue mentioned in > "WAL Compression" doc: https://hbase.apache.org/book.html#wal.compression > > A possible downside to WAL compression is that we lose more data from the >

Re: [ANNOUNCE] Apache HBase 2.1.10 is now available for download

I removed the below user from hbase lists for flagrant violation of our Code of Conduct [1] after chatting w/ the PMC. Pardon the noise, S 1. https://hbase.apache.org/coc.html On Thu, Apr 9, 2020 at 8:46 AM Sean Kennedy wrote: > Zhang, Have you ever conspired in espionage on behalf of the

Re: Is there any way to check the system stop is requested in performCompaction over time?

java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java#L367 > [2]: > https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java#L420-L429 > > Best regards, > Minwoo Kang > > __

Re: org.apache.hadoop.net.DNS exception on ipv6

On Fri, Mar 13, 2020 at 7:41 PM tomas tim wrote: > hi,all > I start hbase in a vmware environment using following config and fail. > the reason is org.apache.hadoop.net.DNS can not adapt IPv6 address, is this > a bug? what can I do except turn off ipv6 config? > > config: > >

Re: Is there any way to check the system stop is requested in performCompaction over time?

On Mon, Feb 24, 2020 at 8:20 PM Kang Minwoo wrote: > Hello Users. > > Is there any way to check the system stop is requested in > performCompaction over time? > > When the region got a close request, the region should wait there is no > compaction and flush. > However, in performCompaction

Re: HBase Spark Connector for HBase 1.x

On Thu, Jan 16, 2020 at 6:58 AM Tucker B wrote: > Curious if the HBase Spark Connector > is expected > to work with HBase 1.x. I see a dependency on HBase 2.2.2 but curious if > HBase 1.x support is available. No. The connector is

Re: HBase hung Command

On Wed, Jan 8, 2020 at 7:39 AM etp wrote: > Hi, > > I have a cluster running Hbase with 1 Master and 6 RS. Recently I noticed > that Hbase commands are sort of queuing up and possibly hung(RUNNABLE > state) > for one table. > When checking the state of the table, I an see that the table is

Re: Extremely long flush times

All Regions or just the one? Do thread dumps lock thread reading against hdfs every time you take one? Is it always inside in updateReaders? Is there a bad file or lots of files to add to the list? Yours, S On Thu, Jan 2, 2020 at 8:34 PM Kang Minwoo wrote: > Hello Users, > > I met an issue

Re: Coprocessor restart after region split rollback

On Fri, Oct 25, 2019 at 12:40 AM Ondrej Kvasnicka wrote: > Hi all, > > we are seeing the following behavior in our HBase (version 1.1) and are > not sure whether it is an intended behavior or possibly a bug: > > We have a custom coprocessor loaded (RegionObserver implementation) and > see that

Re: Regions with same start key & overlapping regions

On Thu, Oct 24, 2019 at 12:20 PM Maz wrote: > Hi all, > We have been using hbase 1.4.8 with hadoop 2.9.2 (with few backports). > After starting hbase, we saw many regions with same start keys and > overlapping regions, which was causing job failures. (with out of row > exceptions). > After

Re: Import TSV - too many args/columns

ssing the cmd line to the ImportTsv MR java application. Thanks, S > -Original Message- > From: Stack [mailto:st...@duboce.net] > Sent: Thursday, October 17, 2019 10:43 AM > To: Hbase-User > Subject: Re: Import TSV - too many args/columns > > CAUTION: This email orig

Re: Import TSV - too many args/columns

SV isn't really an option, as we're using a managed Hbase > instance on AWS EMR. > > -Original Message- > From: Stack [mailto:st...@duboce.net] > Sent: Wednesday, October 16, 2019 11:25 AM > To: Hbase-User > Subject: Re: Import TSV - too many args/columns > > CAUTION: Th

Re: Import TSV - too many args/columns

You've tried search net for how others deal with arg list too long? You might have to hack on the importtsv script? S On Tue, Oct 15, 2019 at 2:41 PM Gautham Acharya wrote: > I'm trying to use the ImportTSV utility to generate HFiles and move them > into an instance using the CompleteBulkLoad

Re: [ANNOUNCE] end of maintenance (EOM) for Apache HBase 2.0 releases

Thanks Sean for bringing down the curtain. S On Tue, Sep 24, 2019 at 11:42 AM Sean Busbey wrote: > hi folks! > > As previously planned the 2.0 release line is now end of maintenance. > Apache HBase 2.0.6 was the final release and is still available from > archive.apache.org. > > Users of 2.0

Re: NOTICE: hbase-2.2.1, 2.1.6 and 2.0.6 have a bug may cause data loss

ine. Please > avoid downloading these releases. If you already running these versions in > your cluster, please use splitormerge_switch to disable region merge > now. See HBASE-23044 for more details. > > Need to rolling new release for branch-2.1 and branch-2.2 line. Ping @stack >

Re: Custom filter appears to just hang

On Sun, Sep 15, 2019 at 9:35 AM Mike Thomsen wrote: > So that's just it, I don't see any errors at all on either the client side > or the server side. I'm running this against HBase 2.0.5, and I didn't see > anything showing up. Granted, I'm running server in local mode with just > "bin/hbase

Re: Retrieving large rows from Hbase

, suggest filing an issue. I don't know of much by way of perf profiling assembling up wide rows. Would be worth digging in. Thanks, S > -Original Message----- > From: Stack [mailto:st...@duboce.net] > Sent: Saturday, September 14, 2019 9:16 AM > To: Hbase-User > Subject: R

Re: Retrieving large rows from Hbase

On Thu, Sep 12, 2019 at 6:14 PM Gautham Acharya wrote: > Hi, > > I'm new to this distribution list and to Hbase in general, so I apologize > if I'm asking a basic question. > > I'm running an Apache Hbase Cluster on AWS EMR. I have a table that is a > single column family, 75,000 columns and

Re: [VOTE] The third HBase 2.2.1 release candidate (RC2) is available

+1 IMO, CHANGES and RELEASENOTES should accumulate all changes, not just show what is in current release. Compat report looks good. Built from src. Ran a loading and verified it there across restart. Checked sigs and hash on src tgz (Duo, sign Guanghao's key and vice-versa -- key is not 'a trusted

Re: Is there any way to batch conditional mutations

Cosmin: On Mon, Sep 9, 2019 at 11:18 AM Cosmin Lehene wrote: > Hi, > > I'm trying to figure out if I can do any of the following: > > * checkAndMutate with more than one condition (e.g. OR) > > Doesn't look like it. The CheckAndMutateBuilder implementation only allows setting one comparator

Re: Region Replicas/Timeline Consistent Reads Questions

On Tue, Aug 27, 2019 at 11:28 AM Jacob Schlather wrote: > I'm currently working on testing out the timeline consistent feature > > https://archive.cloudera.com/cdh5/cdh/5/hbase-0.98.6-cdh5.2.4/book/arch.timelineconsistent.reads.html > and I > had a couple of questions. > > 1. I setup region

[ANNOUNCE] Apache HBase 2.0.6, the last 2.0.x release, is now available for download

The HBase team is happy to announce the immediate availability of Apache HBase 2.0.6. This also happens to be the last release we will make off branch-2.0; there will be no hbase-2.0.7, etc., unless extraordinary circumstance. Download from https://hbase.apache.org/downloads.html Apache HBase is

Re: Does Hedged-read usually happen in real workloads?

On Mon, Aug 19, 2019 at 5:30 AM Daegyu Han wrote: > Hi all, > > To my understand, Hedged-Read is a technique for copying IO to a replica > when pread () is delayed to mitigate IO latency such as speculative > execution in MapReduce. > > The release note on the feature has a pretty good

Re: Region-server crash: Added a key not lexically larger than previous

Interesting. The Cells differ in sequence id. Would seem to imply race around the getting of sequenceid writing the WAL. The crashes are happening on regionserver replay of WAL files recovering crashed server? Or when is it happening? If the former, you might have to find the offending WAL and

Re: [VOTE] The first HBase 2.2.1 release candidate (RC0) is available

See https://builds.apache.org/view/H-L/view/HBase/job/HBase-Find-Flaky-Tests/job/branch-2.2/lastSuccessfulBuild/artifact/dashboard.html See the second paragraph, the tests that run on gce. Looks like they fail 100%. S On Wed, Aug 14, 2019 at 7:35 PM 张铎(Duo Zhang) wrote: > Nightly will exclude

[ANNOUNCE] branch-2.0 is being EOL'd. 2.0.6, currently in RC, will be the last 2.0.x release

Heads-up, branch-2.0 is being EOL'd. An old discussion thread had it that we should wait until 2.2.0 had shipped and that we should then cut one last release [1]. The 2.0.6 that is currently in release candidate state will be the last release off branch-2.0 (unless unforeseen circumstance).

Re: [ANNOUNCE] new HBase committer Sakthi

Hurray! S On Wed, Jul 31, 2019 at 5:04 PM Sean Busbey wrote: > On behalf of the HBase PMC, I'm pleased to announce that Sakthi has > accepted our invitation to become an HBase committer. > > We'd like to thank Sakthi for all of his diligent contributions to the > project thus far. We look

Re: The note of the round table meeting after HBaseConAsia 2019

Thanks for the thorough write-up Duo. Made for a good read S On Fri, Jul 26, 2019 at 6:43 AM 张铎(Duo Zhang) wrote: > The conclusion of the HBaseConAsia 2019 will be available later. And here > is the note of the round table meeting after the conference. A bit long... > > First we talked

Re: [Announce] 张铎 (Duo Zhang) is Apache HBase PMC chair

Thank you Misty for your years of service (FYI, for non-PMCers, the reports Misty wrote to the Apache Board on our behalf were repeatedly called out for their quality and thoughtfulness). Duo Zhang, thank you for taking on the mantle. S On Thu, Jul 18, 2019 at 10:46 AM Misty Linville wrote: >

Re: Failed to create assembly

: > /ws/hbase-2.1.5-src/hbase-common/target/test-classes isn't a file. -> [Help > 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the > -e switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERRO

Re: Infinite loop ReopenTableRegionsProcedure

Looks like known issue. Can you update to later branch-2.0 release or patch what you have? Thanks, S On Thu, Jul 4, 2019 at 6:59 PM Jacobo Coll wrote: > Hi > > I'm trying to create a view against an existing hbase table, which adds > some coprocessors to the table. I'm using Hortonworks 3.1.2,

Re: High Priority RPC handler usage with meta replication - block read errors?

Thanks James for your response too, I hope you're doing well :) We have a > bunch of cold-meta-cache hadoop jobs that are indeed likely contributing to > the load on meta. > > On Fri, Jun 28, 2019 at 12:14 AM Stack wrote: > > > On Wed, Jun 26, 2019 at 6:47 AM James Kebinger &g

Re: High Priority RPC handler usage with meta replication - block read errors?

If early 2.0 or 2.1 versions, perhaps it is HBASE-21292 ? S On Thu, Jun 27, 2019 at 10:13 PM Stack wrote: > On Wed, Jun 26, 2019 at 6:47 AM James Kebinger > wrote: > >> Hello, >> We're experimenting with meta table replication > > > Replicating the meta t

Re: High Priority RPC handler usage with meta replication - block read errors?

t; org.apache.hadoop.hdfs.BlockReaderFactory.getRemoteBlockReader(BlockReaderFactory.java:881) > at > > org.apache.hadoop.hdfs.BlockReaderFactory.getRemoteBlockReaderFromTcp(BlockReaderFactory.java:759) > at > > org.apache.hadoop.hdfs.BlockReaderFactory.build(BlockReaderFactory.java:376) > > Doing a stack dump

Re: Question regarding maximum row size.

On Wed, Jun 26, 2019 at 1:08 PM Vitaliy Semochkin wrote: > Hi, > > I have an analytical report that would be very easy to build > if I could store thousands of cells in one row each cell storing about > 2kb of information. > I don't need those rows to be stored in any cache, because they will >

Re: Trying to execute a put to docker cloudera hbase

On Thu, Jun 27, 2019 at 1:25 AM Guillermo Ortiz Fernández < guillermo.ortiz.f...@gmail.com> wrote: > I'm trying to insert a record in HBase. I have a docker cloudera > quickstarter image. > I can connect to zookeeper and hbase port from my machine to the docker > expose ports with telnet (2181,

Re: [ANNOUNCE] Apache HBase 2.1.5 is now available for download

Hopefully not (Thanks for calling it out Sakthi) S On Wed, Jun 5, 2019 at 9:02 AM Sakthi wrote: > I hope users don't get confused by different version numbers in the subject > and in the first para. :) Though a very minor thing. > > Sakthi > > On Wed, Jun 5, 2019 at 8:

[ANNOUNCE] Apache HBase 2.1.5 is now available for download

The HBase team is happy to announce the immediate availability of Apache HBase 2.1.4. Download from https://hbase.apache.org/downloads.html Apache HBase is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with

Re: SplitNormalizationPlan SplitPoint

Austin: Looks like oversight to me. As you suggest, you'd think the split point -- if present -- would be passed to the admin split call. Mind putting up a patch sir? Thanks, S On Mon, May 27, 2019 at 2:36 PM aheyne wrote: > Hey all, > > We've been having good fun working with custom

Re: hbase 2.1.4: insert error: cannot get replica 0

Check the logs on the servers? Anything untoward? For example, if you look in the master logs, any complaints about regions having trouble onlining? What version of hbase? Thanks, S On Wed, Apr 24, 2019 at 12:31 AM Michael wrote: > Hi, > > I try to run an insert job implemented in java, but

Re: build hbase 2.1.4 for hadoop 3.1.2

Try: $ mvn clean install -Dhadoop.profile=3.0 -Dhadoop-three.version=3.1.2 -DskipTests assembly:single -Dhadoop.profile=3.0 asks for the 3.0 profile. -Dhadoop-three.version=3.1.2 sets the hadoop 3.0 version to use. S On Wed, Apr 3, 2019 at 7:13 AM Michael wrote: > Sorry, the last mail

Re: no regions assigned after disk replacement

Some log snippets would help. For sure the Master was all the ways up? Thanks, S On Tue, Apr 2, 2019 at 7:30 AM marjana wrote: > Restarting the whole cluster fixed it, I see the regions assigned to all > nodes. > > > > -- > Sent from: >

Re: splitPoint parameter in splitRegionAsync

The end key of one region is the start key of the next so cecking the startkey is sufficient? Thanks Kevin, S On Tue, Mar 26, 2019 at 1:47 PM kevin su wrote: > Hi Users, > > I found that when we start to split region, used splitRegionAsync in > HbaseAdmin. > it only check whether the

Re: Debugging High I/O Wait

Mind putting up a thread dump? How many spindles? If you compare the i/o stats between a good RS and a stuck one, how do they compare? Thanks, S On Wed, Mar 27, 2019 at 11:57 AM Srinidhi Muppalla wrote: > Hello, > > We've noticed an issue in our HBase cluster where one of the >

Re: splitPoint parameter in splitRegionAsync

That sounds right Kevin. Mind adding pointer to where in the code you are referring to? Thanks, S On Tue, Mar 26, 2019 at 1:47 PM kevin su wrote: > Hi Users, > > I found that when we start to split region, used splitRegionAsync in > HbaseAdmin. > it only check whether the splitPoint is startkey

[ANNOUNCE] Apache HBase 2.1.4 is now available for download

The HBase team is happy to announce the immediate availability of Apache HBase 2.1.4. Download from https://hbase.apache.org/downloads.html Apache HBase is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with

[ANNOUNCE] Apache HBase 2.0.5 is now available for download

The HBase team is happy to announce the immediate availability of Apache HBase 2.0.5. NOTICE: We plan on this being the last release on branch-2.0 (unless critical issues found). Download from https://hbase.apache.org/downloads.html Apache HBase is an open-source, distributed, versioned,

Re: IOException in Get.readVersions()

It should have been an IAE. As a community, we famously have an addition to IOE [1]. S 1. https://blog.tsunanet.net/2012/04/apache-hadoop-abuse-ioexception.html On Mon, Mar 18, 2019 at 3:07 PM strijbol.n...@gmail.com < strijbol.n...@gmail.com> wrote: > Hi, > > The readVersions(int) method on

Re: A little typo in ClusterConnection

File an issue Kevin? Maybe attach a patch? Thank you, S On Wed, Mar 13, 2019 at 1:51 AM kevin su wrote: > Hi, > > I clone the latest the hbase from github. > i found the comment on the top in ClusterConnection from > org.apache.hadoop.hbase.client. > > /** > * > > * Licensed to the Apache

Re: When should we use volatile modifier in HMaster?

On Thu, Mar 14, 2019 at 12:34 AM yuhang li <89389114...@gmail.com> wrote: > Hi all, I'm developing some new features based on HBase-1.2.9 Its best to develop against master first and then we backport to other branches. You've seen announcements that hbase-1.2 is sunsetting that it'll be

Re: coprocessor and hbase.regionserver.handler.count

On Mon, Jan 14, 2019 at 5:37 PM ming.liu wrote: > Hi, all, > > > > Our application is using coprocessor to communicate with HBase, not using > the get()/put() client API. When there are large concurrency, the > performance is degrading very fast. > > Can you figure why? Thread-dumping, profiler?

Re: Bring HBase online with tables disabled

Is it a new zk instance on each restart? If so, try saving the zk data restoring it before you restart the hbase cluster. S On Tue, Jan 15, 2019 at 6:57 AM aheyne wrote: > I'm using HBase 1.4.8 on EMR and whenever I restart HBase I disable all > the tables before hand and shut down but after I

[ANNOUNCE] Apache HBase 2.1.2 is now available for download

The HBase team is happy to announce the immediate availability of Apache HBase 2.1.2. Download from https://hbase.apache.org/downloads.html Apache HBase is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with

[ANNOUNCE] Apache HBase 2.0.4 is now available for download

The HBase team is happy to announce the immediate availability of Apache HBase 2.0.4. Download from https://hbase.apache.org/downloads.html Apache HBase is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with

Re: Sorting keys with HFile.Writer

On Tue, Jan 1, 2019 at 8:42 AM Mike Thomsen wrote: > Thanks. Is there any value in me specifying the comparator? > > You want to have a sort that is other than the natural hbase sort? It is possible to specify your own comparator but you won't be able to put the resulting hfiles under hbase for

Re: Will Scan use blockcache?

On Sat, Dec 29, 2018 at 8:06 AM ming.liu wrote: > Thanks Stack, > > I have an impression that Get makes a Scan under the cover. But that > cannot explain my observation of the performance difference between Get a > single row vs. San a single row. > > Here is how t

Re: Will Scan use blockcache?

A Get is a one-row Scan. Under the covers the Get makes a Scan. Scan/Get both have to go to memstore since it will have latest versions of Cells. Say more about how you are doing the compare please. S On Sat, Dec 29, 2018 at 7:02 AM ming.liu wrote: > Hi, all, > > > > I recently found that

Re: How should I be getting the set of regions in transition?

On Thu, Dec 6, 2018 at 7:45 AM Sean Busbey wrote: > This week I've run into two cases where I needed the set of regions in > transition so I could recover them and I ran into what I think is a > gap in our operator tooling. I'm hoping folks will have some ideas > I've missed. > > Depending on

Re: HBase Get Encounters java.lang.IndexOutOfBoundsException

rinter.java:255) > > > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > > > > at > > org.apache.hadoop.hbase.io > .hfile.HFilePrettyPrinter.main(HFilePrettyPrinter.java:677) > > > > On Wed, Dec 5, 2018 at 2:24 PM William Shen &g

Re: [DISCUSS] No more release branches for 1.x, release from branch-1 directly

developing' branch? > > > > > > > > I think for branch-1 it is fine, as we are not likely to backport any > > big > > > > new feature to 1.x any more. And does this mean that 1.5 is the last > > > minor > > > > release line for 1.x? &g

Re: [DISCUSS] EOL branch-1.3

+1 (Pity you have to make a release to EOL it). S On Fri, Dec 7, 2018 at 11:25 AM Andrew Purtell wrote: > We haven't had a release from branch-1.3 for a long time and do not appear > to have an active RM for it. Unless a RM for 1.3 steps forward and promises > to make a release in the very

Re: [DISCUSS] No more release branches for 1.x, release from branch-1 directly

On Fri, Dec 7, 2018 at 11:36 AM Andrew Purtell wrote: > Please be advised I plan to RM the next minor release from branch-1, 1.5.0, > in January of 2019. Once this is done we can continue making maintenance > releases from branch-1.4 as needed but expect that not to be necessary > after a couple

NOTICE: hbase-2.1.1 and 2.0.3 have a memory leak

We are working on replacements. Only 2.1.1 and 2.0.3 are effected. Earlier releases are fine. Please avoid downloading these releases in the meantime. Yours, S P.S. For detail, see HBASE-21551

Re: HBase Get Encounters java.lang.IndexOutOfBoundsException

Looks like bug in FastDiffDeltaEncoder triggered by whatever the current form of the target file. Can you figure which file it is (going by the Get coordinates?). I suppose the compactor is running into the same problem (was thinking a major compaction might get you over this hump). You could make

[ANNOUNCE] Apache HBase 2.0.3 is now available for download

The HBase team is happy to announce the immediate availability of Apache HBase 2.0.3 Apache HBase is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized hardware. To

Re: hbase maven build error

k above for specific messages explaining why the rule failed. -> > [Help 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the -e > switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more in

Re: question on column families

On Tue, Nov 13, 2018 at 7:20 PM Antonio Si wrote: > Thanks Allan. > > Then, why is it a problem of having too many column families? If there are > column > families with no data, would that cause any issues? > > Thanks. > > `We have this note in the refguide [1]. It is a bit stale though. Each

  1   2   3   4   5   6   7   8   9   10   >