Re: Error : hbase-default.xml file seems to be for an older version

Does 'driver-class-path' come after --jars path? What if you put the conf reference on --jars path? Or, one of the jars has an hbase-default.xml in it that has not be interpolated with version info. Adding a jar with interpolated hbase-default.xml at head of the list of jars should fix it.

HBaseCon2016 Agenda is up in case you haven't noticed

Check it out: http://hbasecon.com/ Thanks, St.Ack

Re: Store Large files on HBase/HDFS

On Thu, Mar 31, 2016 at 6:42 PM, Arun Patel wrote: > [image: Mic Drop] > Since there are millions of files (with sizes from 1mb to 15mb), I would > like to store them in a sequence file. How do I store the location of each > of these files in HBase? > > I see lots blogs

Re: Inconsistent scan performance

al # partitions:26; partition_number:24; rows:1738634 elapsed_sec:34.025 > ops/sec:51098.72152828803 > total # partitions:26; partition_number:25; rows:1736522 elapsed_sec:38.673 > ops/sec:44902.69697204768 > > I can't make rhyme or reason of it. There seems to be an imperfect > region-

Re: Inconsistent scan performance

nd S->Z for example. > > > >> On Fri, Mar 25, 2016 at 6:51 AM, Anoop John <anoop.hb...@gmail.com> > wrote: > >> > >> I see you set cacheBlocks to be false on the Scan. By any chance on > >> some other RS(s), the data you are looking for is already

Re: Inconsistent scan performance

On Thu, Mar 24, 2016 at 4:45 PM, James Johansville < james.johansvi...@gmail.com> wrote: > Hello all, > > So, I wrote a Java application for HBase that does a partitioned full-table > scan according to a set number of partitions. For example, if there are 20 > partitions specified, then 20

Re: Database browser tools for Phoenix on Mac

On Tue, Mar 8, 2016 at 4:57 PM, anil gupta wrote: > Yeah, i have looked at that. Non-commercial only provides very basic > feature. > I have just tried DBeaver(http://dbeaver.jkiss.org/download/). Its based > on > Eclipse framework and its UI looks much better. > DBeaver

Re: HBase poor write performance

On Tue, Mar 8, 2016 at 8:49 AM, Frank Luo wrote: > Akmal, > > We have been suffering the issue for two years now without a good > solution. From what I learned, it is not really a good idea to do heavy > online hbase puts. The first thing you encounter will be performance

Re: HBase poor write performance

On Tue, Mar 8, 2016 at 8:28 AM, Akmal Abbasov wrote: > Hi, > I'm testing HBase to choose the right hardware configurations for a heavy > write use case. I'm testing using YCSB. > The cluster consist of 2 masters, and 5 regionservers(4 cores, 14GB ram, > 4x512GB SSD). >

Re: MOB in branch-1? (Re: [RESULT][VOTE] Merge branch hbase-11339 HBase MOB to trunk)

On Mon, Feb 29, 2016 at 6:56 PM, Jonathan Hsieh wrote: > ... > We've been working on trying to get at least one of them to present at > hbasecon, but I'm not reviewing submissions this year and don't know if > they made it or not. > > This did not happen. The use case is to

Re: HBase on Tachyon/alluxio

achyon URL rather than HDFS? HBase can digest different URLs -- file, s3, etc. Just needs to be a provider. Have you tried it? Would be interesting to hear how it works out. St.Ack > > > 2016-02-29 19:19 GMT+01:00 Stack <st...@duboce.net>: > > > On Mon, Feb 29, 2016 at

Re: HBase on Tachyon/alluxio

On Mon, Feb 29, 2016 at 5:32 AM, Serega Sheypak wrote: > Hi, did anyone consider running HBase on top of http://www.alluxio.org/ ? > Does it make sense? > It'd probably run great until you crash... St.Ack

Re: Some problems in one accident on my production cluster

On Wed, Feb 24, 2016 at 3:31 PM, Heng Chen wrote: > The story is I run one MR job on my production cluster (0.98.6), it needs > to scan one table during map procedure. > > Because of the heavy load from the job, all my RS crashed due to OOM. > > Really big rows? If

Re: NPE on ProtobufLogWriter.sync()

gt; that > > > the > > > > problem might be other. > > > > > > > > *(log.out) * > > > > > > > >> /usr/hdp/current/hbase-regionserver/bin/hbase-daemon.sh: line 214: > > 20748 > > > >> Killed nice -n $

Re: NPE on ProtobufLogWriter.sync()

06 AM, Pedro Gandola <pedro.gand...@gmail.com> > wrote: > > > Hi St.Ack, > > > > Thank you for your help. I have attached ~5 min worth of data before the > > crash. > > > > I restarted the cluster to update some configurations after that I moved >

Re: Disable table command hangs in hbase shell in HBase 1.1.2

On Tue, Feb 16, 2016 at 8:30 AM, Anthony Nguyen wrote: > Hi all, > > I'm running into an issue in HBase 1.1.2 where after a cluster is running > for some time, disabling a table in the shell has no effect, hanging until > the timeout limit is reached. Looking at the

Re: NPE on ProtobufLogWriter.sync()

On Mon, Feb 15, 2016 at 3:07 PM, Pedro Gandola wrote: > Hi Guys, > > One of my region servers got into a state where it was unable to start and > the cluster was not receiving traffic for some time: Were you trying to restart it and it wouldn't come up? It kept doing

Re: Confusion with new 1.0 clint API

. St.Ack On Wed, Feb 10, 2016 at 12:33 AM, Serega Sheypak <serega.shey...@gmail.com> wrote: > It helped, thanks. > Now I have single reusable BufferedMutator instance and I don't call > .close() after mutations, I call .flush() Is it ok? > > 2016-02-09 23:09 GMT+01:00 St

Re: Confusion with new 1.0 clint API

ried obtaining / closing mutator for each User instead of > sharing > > the mutator ? > > > If another flush, say because there were lots of puts, then when close > > comes in, we are out of threads and you'd get below. > Looks like it's the root cause, let me try! >

Re: Confusion with new 1.0 clint API

tatorParams()) > > List putList = users.collect{toPut(it)} > mutator.mutate(putList) > *mutator.close() // exception here* > } > } > > Exception is still thrown > > 2016-02-09 15:43 GMT+01:00 Stack <st...@duboce.net>

Re: Confusion with new 1.0 clint API

On Mon, Feb 8, 2016 at 3:01 PM, Serega Sheypak wrote: > Hi, I'm confused with new HBase 1.0 API. API says that application should > manage connections (Previously HConnections) on their own. Nothing is > managed itnernally now. > > That is right. > Here is an

Re: Changing logging settings

On Thu, Jan 28, 2016 at 2:44 AM, Akmal Abbasov wrote: > Hi, > I modified the default settings for logging in HBASE, by > editing log4j.properties in $HBASE_HOME/conf directory. > Here is settings, > ... > # Rolling File Appender properties > hbase.log.maxfilesize=256MB

Re: parallel scanning?

On Mon, Jan 25, 2016 at 10:29 AM, Henning Blohm wrote: > Hi, > > I am looking for advise on an HBase mass data access optimization problem. > > In our application all data records stored in Hbase have a time dimension > (as inverted time) and a GUID in the row key.

Re: Is HBase standalone viable for production?

Sorry for the late response John. On Tue, Jan 26, 2016 at 8:25 AM, John Lilley wrote: > We would like to build software using HBase and Phoenix without > necessarily requiring the Hadoop ecosystem for smaller deployments and I > have some basic concerns: > -- Is this a

Re: Thrift server 2 in Hbase

On Tue, Jan 26, 2016 at 9:02 PM, Rajeshkumar J wrote: > Hi, > > > I have table named temp in hbase. First I have started the thrift server > 1 and queried the table and also it returns the result. > Then I have stopped the thrift server 1 and now I have started

Re: hbasecon2016: Call For Papers is up (Closes Feb 28th).

Thanks Anil. Use this instead to get to the easychair page where you submit your abstracts: https://goo.gl/A3LTPY St.Ack On Wed, Jan 27, 2016 at 10:53 AM, Stack <st...@duboce.net> wrote: > Share your stories on how you are using and abusing hbase with your > community peers at

Re: All RegionServers stuck on BadVersion from ZK after cluster restart

M, tsuna <tsuna...@gmail.com> wrote: > > On Wed, Jan 27, 2016 at 3:31 AM, Stack <st...@duboce.net> wrote: > >> Can you try what Samir suggests? Can replay moved-aside logs using > >> WALPlayer after cluster comes up. > > > > OK I’ll shut down the HM an

Re: [VOTE] Second release candidate for HBase 1.0.3 (RC1) is available. Please vote by Jan 26 2016

+1 Checked signatures and hash. Built from src. Loaded data and verified it made there. Checked logs. Poked around the package, all looks good St.Ack On Wed, Jan 20, 2016 at 12:29 AM, Enis Söztutar wrote: > I am pleased to announce that the second release candidate for

Re: All RegionServers stuck on BadVersion from ZK after cluster restart

Can you try what Samir suggests? Can replay moved-aside logs using WALPlayer after cluster comes up. I see that at first we are making progress through the WALs ("... total tasks = 7..." ... it was 9 in your master log) but maybe they are getting stuck on particular WALs. The stuck Master has

hbasecon2016: Call For Papers is up (Closes Feb 28th).

Share your stories on how you are using and abusing hbase with your community peers at hbasecon2016. Submit an abstract here: https://goo.gl/qKJrK3 (If you need a hand figuring your submission, ping me off list). Looking forward to it... St.Ack

Re: data write/read consistency issue

le.put. > getTagColumns uses a ColumnPrefixFilter to get all the columns starting > with "tag_". > > The other possiblity is that some other processes removed the new id > between the call of add and get. But we checked other code logic and it > seems not likely. or the

Re: data write/read consistency issue

On Fri, Jan 22, 2016 at 1:51 AM, Rural Hunter wrote: > Hi, > > I have a hbase cluster with 7 servers at version 0.98.13-hadoop2, > dfs.replication=2. > In a write session, we update some data. Then in a new read session > immediately, we read the data using Get class and

Re: Put performance test

Why the crash? Is it in the library or hbase? Thanks, St.Ack On Tue, Dec 22, 2015 at 11:00 AM, Kumiko Yada wrote: > Hello, > > I wrote the python script w/ happybase library to do the performance put > test; however, this library is crashing when more than 90 rows are

Save the date and other notes

HBaseCon2016 will be on Tues. May 24, 2016 at The Village on Market St. in SF. Save the date! Call for papers will go out at start of the new year. Keep an eye out. There's a blog post up on the offheaping work that has been going on with a good while now. Lots of

Re: hbase using spark-sql

That project looks nice. The Astro fellows should talk it up... get it added to the hbase site here: http://hbase.apache.org/poweredbyhbase.html File an issue and add a sentence of description (or we'll do it ourselves). Thanks, St.Ack P.S. Anyone else powered-by HBase should similarly file

Re: hbase client in sandboxed GAE environment

On Thu, Dec 10, 2015 at 6:58 AM, Loknath Priyatham Teja Singamsetty < singams.t...@gmail.com> wrote: > Hi Folks, > > I just started on open source hbase. Tried to follow docs to start the > hbase process on hbase-1.1.2 and noticed few warnings related to JDK 8 VM > options (which was a change

Re: Performance testing and tuning

On Wed, Dec 9, 2015 at 8:14 PM, Abraham Tom wrote: > Hi all > does anybody have scripts or examples to do performance tests and > benchmarks on scans > We are using cloudera 2.5.5 hbase 1.0 > and most interaction is via Node.js through Thrift. > we have a table thats

Re: Hconnection closed problem

Why all those NPEs doing increments? Is the increment via thrift now supplying all fields? Is it HBASE-14533/HBASE-14196? These are not in your CDH IIRC. Can you upgrade or do apache hbase? St.Ack On Mon, Nov 30, 2015 at 11:24 PM, Talat Uyarer <ta...@uyarer.com> wrote: > Sorry Sta

Re: Performance degradation between CDH5.3.1(HBase0.98.6) and CDH5.4.5(HBase1.0.0)

back, and aside from > a > > few NoSuchMethodErrors due to API changes (Put#add vs Put#addColumn), it > > seems to be working and fixing our problem. > > > > On Mon, Nov 30, 2015 at 3:47 PM Stack <st...@duboce.net> wrote: > > > >> Rollback i

Re: How to optimize the GC in HBase

On Sat, Nov 28, 2015 at 4:44 PM, 聪聪 <175998...@qq.com> wrote: > hi，all： > This morning regionserver shutdown.By analyzing the log, I guess it's > about GC.Then,How to optimize the GC in HBase. > I use the HBase version is hbase-0.98.6-cdh5.2.0.I look for your help in > this. > > > JVM

Re: High get/scan rates on HBase table even if no readers are on

On Fri, Nov 27, 2015 at 10:11 AM, Mukesh Jha wrote: > I'm working with cloudera hbase v0.98, my HBase table has ~5k regions. > > How many servers do you have carrying the 5k regions? > From the cloudera UI charts i see a lot of get & scan operations active on > my

Re: Performance degradation between CDH5.3.1(HBase0.98.6) and CDH5.4.5(HBase1.0.0)

forward to CDH5.5 to fix? Or is our only hope to roll back to > CDH 5.3.1 (if that is possible)? > > > On Thu, Sep 24, 2015 at 5:06 AM 鈴木俊裕 <brfrn...@gmail.com> wrote: > > > Thank you St.Ack! > > > > I would like to follow the ticket. > > > >

Re: Performance degradation between CDH5.3.1(HBase0.98.6) and CDH5.4.5(HBase1.0.0)

"Increment_99th_percentile": 1635.23998 > > > Any ideas if there are other changes that may be causing a performance > regression for increments between CDH4.7.1 and CDH5.3.8? > > > No. Post a thread dump Bryan and it might prompt something. St.Ack > > On Mo

Re: Performance degradation between CDH5.3.1(HBase0.98.6) and CDH5.4.5(HBase1.0.0)

994a748da83d9f75085 > >>> > >>> An active handler: > >>> > https://gist.github.com/bbeaudreault/2994a748da83d9f75085#file-gistfile1-txt-L286 > >>> One that is locked: > >>> > https://git.hubteam.com/gist/jwilliams/80f37999bfdf55119588

Re: Performance degradation between CDH5.3.1(HBase0.98.6) and CDH5.4.5(HBase1.0.0)

On Mon, Nov 30, 2015 at 9:16 PM, Bryan Beaudreault <bbeaudrea...@hubspot.com > wrote: > I'll try to get another one. We are currently not seeing the issue due to > lack of contention (it is off hours for our customers). > > Note that the stack trace I gave you was taken with a

Re: Performance degradation between CDH5.3.1(HBase0.98.6) and CDH5.4.5(HBase1.0.0)

t; > It always follows the same pattern, of 1 active handler in the upsert and > the rest blocked waiting for it. > > On Mon, Nov 30, 2015 at 6:05 PM Stack <st...@duboce.net> wrote: > > > On Mon, Nov 30, 2015 at 2:31 PM, Bryan Beaudreault < > > bbeaudrea...@hubs

Re: Performance degradation between CDH5.3.1(HBase0.98.6) and CDH5.4.5(HBase1.0.0)

Looking at that stack trace, nothing showing as blocked or slowed by another operation. You have others I could look at Bryan? St.Ack On Mon, Nov 30, 2015 at 8:40 PM, Bryan Beaudreault <bbeaudrea...@hubspot.com > wrote: > Yea sorry if I was misleading. The nonce loglines we saw only

Re: Hconnection closed problem

On Mon, Nov 30, 2015 at 4:34 PM, Talat Uyarer wrote: > Hi, > > I use Hbase 1.0 cmf-5.4. Where does this hbase come from Talat? > Hbase is used for store users' event log. I > write our data with php+thrift. At the beginning everything works > fine. After during a time

Re: Official Docker image

On Sat, Nov 28, 2015 at 7:05 PM, Otis Gospodnetić < otis.gospodne...@gmail.com> wrote: > Hi, > > I was going through Cosmin Lehene's > http://www.slideshare.net/clehene/elastic-hbase-on-mesos and noticed there > was no official HBase Docker image: > >

Re: Disk usage drops after RegionServer restart? (0.98)

ng - Anomaly Detection > Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > > > On Thu, Oct 29, 2015 at 1:52 PM, Stack <st...@duboce.net> wrote: > > > Are you printing out filesize (I don't see the -s arg on lsof). > > St.Ack > > >

Re: HBase and Netty

On Thu, Nov 5, 2015 at 5:42 AM, mukund murrali wrote: > Hi > > I am just curious to know why HBase uses NIO (if not wrong) rather than > netty for communication . What are the pros and cons of using Netty over > NIO or NIO over Netty. > > Our transport was inherited. It

Re: Disk usage drops after RegionServer restart? (0.98)

Are you printing out filesize (I don't see the -s arg on lsof). St.Ack On Fri, Oct 23, 2015 at 8:08 PM, Otis Gospodnetić < otis.gospodne...@gmail.com> wrote: > Hi Ted, > > 0.98.6-cdh5.3.0 > > I did actually try to use lsof, but I didn't see anything unusual there. > Is there something specific I

Re: Opinions wanted: new site skin

ml > > > > > > If you go to > > > > http://mstanleyjones.github.io/hbase/reflow_update/dependency-info.html > > > and a few other parts of the site, you will notice the built-in syntax > > > highlighting. > > > > > > This version

Re: Purging an Hbase table after accidentally deleting the store files

On Mon, Oct 26, 2015 at 1:18 PM, Sam William wrote: > Hi, > I accidentally deleted the HDFS location '/hbase/mytable' before I > dropped the table from the hbase shell. This table was a candidate for > deleting anyway and I don't care about getting it back. I just want

Re: Introducing Project S2Graph

Thanks for posting Do Yung Yoon. St.Ack On Wed, Oct 7, 2015 at 10:57 AM, DO YUNG YOON wrote: > Hello Forks. > > I want to introduce an open-source distributed graph database s2graph on > HBase. > > Here is the github repository and presentations that describe how s2graph >

Re: Hadoop streaming with HBase as data sink

You can't do hadoop streaming into hbase. Maybe explore hbase REST interface and see if you can format puts that hbase REST can digest. St.Ack On Fri, Oct 2, 2015 at 12:00 PM, Pei Zhao wrote: > Hi all, > > I am a graduate student do research in solar cell data management.

Re: Hadoop streaming with HBase as data sink

On Fri, Oct 2, 2015 at 12:46 PM, Pei Zhao <pei.zhao...@gmail.com> wrote: > Hi Stack, > > In my case, I tried to use HBase Thrift API, but Thrift server sometimes > crashes during my MapReduce job, due to out of heap memory. > > Do you have any suggestions on that pleas

Re: HLog's AsyncHLogWriter aborted abruptly

On Tue, Sep 22, 2015 at 12:16 PM, Shrijeet <shrij...@pinterest.com.invalid> wrote: > Thanks Stack. Few comments. > > > > Have you put much work into it? If you went to HBASE-10156, write > > throughput is better again and you'd be on same system as is in current >

Re: HLog's AsyncHLogWriter aborted abruptly

On Mon, Sep 21, 2015 at 5:58 PM, Shrijeet wrote: > HBase Version: 0.94.26 > HDFS version: 2.5.x > > We backported HBASE-8755 onto 0.94.27 Have you put much work into it? If you went to HBASE-10156, write throughput is better again and you'd be on same system as

Re: JVM memory dump.

Are you talking about the linux out-of-memory-killer? I don't know of a way to intercept the kill signal to have it dump java heap (there me be a way). Why is your heap growing? Have you not set -Xmx == -Xms? St.Ack On Wed, Sep 16, 2015 at 9:54 PM, James Teng wrote:

Re: Question about RPC queues

That is the Reader pool.. the pool of Readers that pulls requests off the Socket and passes the request to the Handler to process. Set "hbase.ipc.server.read.threadpool.size". St.Ack On Mon, Sep 14, 2015 at 11:59 AM, kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com> wrote: > If it helps,

Re: table comment

On Fri, Sep 11, 2015 at 4:34 AM, Wojciech Indyk wrote: > Hi! > I need to describe my HBase tables with some text. I try to find a > recommended solution, but I didn't. What I can propose is: > in hbase shell: > alter 'the_table', {CONFIGURATION => {'COMMENT' => 'Here

Re: OutOfOrderScannerNextException

e setting it using hbase-site.xml? > I can't modify titan codes. it only read hbase configuration file. > > On Wed, Sep 9, 2015 at 1:38 AM, Stack <st...@duboce.net> wrote: > > Are you seeing hiccups in the scans ahead of this exception -- scan next > > retrying? Are the rows la

Re: OutOfOrderScannerNextException

You seeing hiccups in the scan ahead of this OOOSNE? Timeouts, retries? St.Ack On Wed, Sep 9, 2015 at 12:54 AM, Li Li <fancye...@gmail.com> wrote: > I tried to set hbase.client.scanner.caching to 1 but still failed. > > On Wed, Sep 9, 2015 at 2:45 PM, Stack <st...@duboce.n

Re: OutOfOrderScannerNextException

The hbase > version is 1.0.0-cdh5.4.4. > it's a full table scan over a large table. Is there any configuration > I can change to tackle this problem. > The exception stack is: > > Exception in thread "main" java.lang.RuntimeException: > org.apache.hadoop.hbase.D

Re: Please welcome new HBase committer Stephen Yuan Jiang

Hurray! On Thu, Aug 20, 2015 at 7:09 PM, Andrew Purtell apurt...@apache.org wrote: On behalf of the Apache HBase PMC, I am pleased to announce that Stephen Jiang has accepted the PMC's invitation to become a committer on the project. We appreciate all of Stephen's hard work and generous

Re: Protobuf Proxy - your feedback is welcomed !

On Wed, Aug 5, 2015 at 9:29 AM, Amit Mor amit@hotmail.com wrote: I've been thinking of creating a new Twemproxy/Thrift ( https://github.com/twitter/twemproxy) like proxy for HBase that would be based on using (as the underlying transport protocol) the native protocol-buffer templates

Re: [DISCUSS] Split up the book again?

On Thu, Jul 30, 2015 at 2:06 PM, Lars Francke lars.fran...@gmail.com wrote: While I like the new and better layout of the book it is painful to use - at least for me - because of its size. I've started to notice this too. It'd be sweet if it loaded more promptly. Thanks for starting the

Re: Can hbase running without hdfs in distribute mode?

On Mon, Jul 13, 2015 at 10:03 PM, 林武康 linwuk...@hikvision.com wrote: Hi all, I have heard that HBase can be deployed as without hdfs in distribute mode, is it true? which version support this feature? or this just a special commercial constomization? HBase in distributed mode depends on a

Re: regionserver.HRegion: Failed getting lock in batch put

On Fri, Jul 10, 2015 at 4:35 AM, 聪聪 175998...@qq.com wrote: hi，all：I use the HBase version is hbase-0.98.6-cdh5.2.0. This afternoon,HBase access failure，use command 'hbase hbck' Check data inconsistencies。 Hmaster on the log is as follows： 2015-07-10 16:24:41,285 INFO

Re: protobuf issue when building hbase 0.94.26 with HDFS 2.5.0

Did you use the protoc compiler from 2.5.0 to regenerate the 0.94 pb classes? St.Ack On Wed, Jul 8, 2015 at 11:21 AM, Neutron sharc neutronsh...@gmail.com wrote: Hi folks, I'm building hbase 0.94.26 with HDFS 2.5.0. I have applied patch HBASE-11076 (to regenerate proto java source files

Re: [DISCUSS] correcting abusive behavior on mailing lists was (Re: [DISCUSS] Multi-Cluster HBase Client)

I like your proposed text Andrew. St.Ack On Fri, Jul 3, 2015 at 2:27 PM, Andrew Purtell apurt...@apache.org wrote: It looks like the discussion is settling down and we have a consensus on the course of action of a three month temporary ban from the project mailing lists. If you feel that is

Re: RegionServer 60030 Show All RPC Handler Task is empty

On Wed, Jul 1, 2015 at 9:18 PM, Louis Hust louis.h...@gmail.com wrote: Hi, all I restart a regionserver and do a balanceswitch manually, the task seems ok You are seeing handler tasks now? On apache branch-1, I see the tasks all WAITING. Let me check a CDH... St.Ack 2015-06-30 15:38

Re: Time series scheme design

To add to Amandeep's pointer, this one is good for concerns modeling timeseries: https://cloud.google.com/bigtable/pdf/CloudBigtableTimeSeries.pdf St.Ack On Wed, Jul 1, 2015 at 11:53 AM, Sleiman Jneidi jneidi.slei...@gmail.com wrote: Hello everyone, I am working on a scheme design for a time

Re: [DISCUSS] correcting abusive behavior on mailing lists was (Re: [DISCUSS] Multi-Cluster HBase Client)

I volunteer to help moderate. St.Ack On Tue, Jun 30, 2015 at 12:08 PM, Sean Busbey bus...@cloudera.com wrote: (I took the liberty of moving us off of Ted's feature discussion thread) A three month ban sounds better than a permanent ban. But it still seems likely to just result in the ban-ee

Re: [DISCUSS] correcting abusive behavior on mailing lists was (Re: [DISCUSS] Multi-Cluster HBase Client)

On Tue, Jun 30, 2015 at 12:18 PM, Stack st...@duboce.net wrote: I volunteer to help moderate. St.Ack Sorry. Changed my mind. I'm not going to do more work because of Michael. Let the filters do the work for us. Ban him for 3 months. St.Ack On Tue, Jun 30, 2015 at 12:08 PM, Sean Busbey

Re: Scan got exception

I checked Vladimir and 5.2.0 is the first release with the necessary HBASE-11678 BucketCache ramCache fills heap after running a few hours. FYI, Thanks, St.Ack On Tue, Jun 30, 2015 at 3:03 PM, Vladimir Rodionov vladrodio...@gmail.com wrote: I believe CDH 5.2.0 does not contain all BucketCache

Re: HBase shell providing wrong results with startrow(with composite key having String and Ints)

On Mon, Jun 8, 2015 at 10:27 PM, anil gupta anilgupt...@gmail.com wrote: So, if we have to match against non-string data in hbase shell. We should always use double quotes? Double-quotes means the shell (ruby) will interpret and undo any escaping -- e..g. showing as hex -- of binary

Re: DNS mismatch between master and regionserver causes doubly registered regionservers

On Fri, May 22, 2015 at 10:17 AM, Bryan Beaudreault bbeaudrea...@hubspot.com wrote: In our system each server has 2 dns associated with it, one always points to a private address and the other to public or private depending on the context. This issue did not show up in 0.94.x, but is

Re: DNS mismatch between master and regionserver causes doubly registered regionservers

On Fri, May 22, 2015 at 10:12 PM, Stack st...@duboce.net wrote: On Fri, May 22, 2015 at 10:17 AM, Bryan Beaudreault bbeaudrea...@hubspot.com wrote: In our system each server has 2 dns associated with it, one always points to a private address and the other to public or private depending

Re: Optimizing compactions on super-low-cost HW

. Work on your flushing and compactions before you mess w/ WAL. What version of hbase are you on? You say CDH but the newer your hbase, the better it does generally. St.Ack 2015-05-20 18:04 GMT+03:00 Stack st...@duboce.net: On Mon, May 18, 2015 at 4:26 PM, Serega Sheypak serega.shey

Re: How to know the root reason to cause RegionServer OOM?

On Wed, May 20, 2015 at 1:46 AM, David chen c77...@163.com wrote: Thanks Ted, For scenario #1, can not see any clues in regionserver log file that denotes kill -9 command was executed. Meanwhile, i think when JVM inspects regionserver process OOME, it will create a new thread to execute kill

Re: Optimizing compactions on super-low-cost HW

On Mon, May 18, 2015 at 4:26 PM, Serega Sheypak serega.shey...@gmail.com wrote: Hi, we are using extremely cheap HW: 2 HHD 7200 4*2 core (Hyperthreading) 32GB RAM We met serious IO performance issues. We have more or less even distribution of read/write requests. The same for datasize.

Re: How to know the root reason to cause RegionServer OOM?

On Tue, May 12, 2015 at 7:41 PM, David chen c77...@163.com wrote: A RegionServer was killed because OutOfMemory(OOM), although the process killed can be seen in the Linux message log, but i still have two following problems: 1. How to inspect the root reason to cause OOM? Start the

New post on hbase-1.1.0 throttling feature up on our Apache blog

.. by our Govind. See here: https://blogs.apache.org/hbase/entry/the_hbase_request_throttling_feature St.Ack

Re: Upgrading from 0.94 (CDH4) to 1.0 (CDH5)

On Tue, May 5, 2015 at 8:58 AM, Bryan Beaudreault bbeaudrea...@hubspot.com wrote: Hello, I'm about to start tackling our upgrade path for 0.94 to 1.0+. We have 6 production hbase clusters, 2 hadoop clusters, and hundreds of APIs/daemons/crons/etc hitting all of these things. Many of these

Re: [ANNOUNCE] Announcing Trafodion 1.1

Congrats Trafodion. Thanks for posting notice here. St.Ack On Mon, May 4, 2015 at 9:12 AM, Birdsall, Dave dave.birds...@hp.com wrote: Good morning HBasers, I'm pleased to announce that Trafodion Release 1.1 is now available for download at http://downloads.trafodion.org/. This is a minor

Re: [VOTE] First release candidate for HBase 1.1.0 (RC0) is available.

On Thu, Apr 30, 2015 at 4:26 PM, Enis Söztutar e...@apache.org wrote: The build is broken with Hadoop-2.2 because mini-kdc is not found: [ERROR] Failed to execute goal on project hbase-server: Could not resolve dependencies for project org.apache.hbase:hbase-server:jar:1.1.0: Could not find

Re: HBase Filesystem Adapter

On Thu, Apr 30, 2015 at 6:35 AM, Buğra Çakır bugra.ca...@oranteknoloji.com wrote: Hi, I would like to use HBase with distributed filesystems other than HDFS. Are there any plans for developing filesystem adapters for these distributed filesystems ? (ceph, glusterfs, ...) What are you

Re: HBase standalone connection refused error

Did you alter configuration defaults (Defaults write data to /tmp dir so a restart could cause loss if OS clears tmp). Shutdown all HBase-related services then restart. If still does not log, post link to complete log. Thanks, St.Ack On Tue, Apr 28, 2015 at 9:46 AM, Erdinç Bereketoğlu

Re: [Announcement] DELI: Yet another secondary index on HBase

Thank you for posting this interesting study Yuzhe Tang, St.Ack On Mon, Apr 20, 2015 at 5:28 PM, Richard Tang tristartom.t...@gmail.com wrote: Hi, We would like to announce DELI, a research prototype for secondary index on HBase. DELI is research work from Syracuse University with

Re: hbase.apache.org homepage looks weird on Chrome and Firefox

Are others running into the issue Anil sees? Thanks, St.Ack On Thu, Apr 16, 2015 at 8:13 AM, anil gupta anilgupt...@gmail.com wrote: Chrome: Version 42.0.2311.90 (64-bit) on Mac But, firefox(34.0.5) also displays the page in same way. On Thu, Apr 16, 2015 at 12:58 AM, Ted Yu

hbasecon2015 is coming up fast; May 7th in SF

Are you all coming? We have a nice agenda for you: http://hbasecon.com/agenda/ And all your favorite hbasers will be in attendance for you to tackle and have a chat with. It promises to be a good day out for one and all so be sure to come! Yours, The HBasecon Program Committee Registration is

Re: toStringBinary output is painful

On Mon, Apr 13, 2015 at 3:16 PM, Dave Latham lat...@davelink.net wrote: Wish I had started this conversation 5 years ago... When we're using binary data, especially in row keys (and therefore region boundaries) the output created by toStringBinary is very painful to use: - mix of ascii /

Re: Recovering from corrupt blocks in HFile

On Tue, Mar 17, 2015 at 11:42 PM, Mike Dillon mike.dil...@synctree.com wrote: Thanks. I'll look into those suggestions tomorrow. I'm pretty sure that short-circuit reads are not turned on, but I'll double check when I follow up on this. The main issue that actually led to me being asked to

Re: Recovering from corrupt blocks in HFile

the start of the index blocks with DFSClient DEBUG enabled but I grep out the DFSClient emissions only: [stack@c2020 ~]$ ./hbase/bin/hbase --config ~/conf_hbase org.apache.hadoop.hbase.io.hfile.HFile -h -f /hbase/data/default/tsdb/3f4ea5ea14653cee6006f13c7d06d10b/t/68b00cb158aa4d839f1744639880f362

Re: Recovering from corrupt blocks in HFile

On Tue, Mar 17, 2015 at 9:47 PM, Stack st...@duboce.net wrote: On Tue, Mar 17, 2015 at 5:04 PM, Mike Dillon mike.dil...@synctree.com wrote: Hi all- I've got an HFile that's reporting a corrupt block in hadoop fsck and was hoping to get some advice on recovering as much data as possible

Re: hbase compaction stuck

Your networking is broken. Fix the 'java.net.NoRouteToHostException: No route to host' exceptions then come back to this list if still issues. Yours, St.Ack On Mon, Mar 16, 2015 at 7:54 AM, Chen Song chen.song...@gmail.com wrote: We ran a hbase cluser with version 0.98.1+cdh5.1.0 and with auto

Re: Standalone == Dev Only?

. What hadoop/hbase versions we talking about? HADOOP-8861 added the above behavior for hadoop 1.2. Try it I'd say. St.Ack Thanks for chiming in. I¹d love to hear more. -j On 3/6/15, 3:02 PM, Wilm Schumacher wilm.schumac...@gmail.com wrote: Hi, Am 06.03.2015 um 19:18 schrieb Stack

Re: significant scan performance difference between Thrift(c++) and Java: 4X slower

Is it because of the 'hop'? Java goes against RS. The thrift C++ goes to a thriftserver which hosts a java client and then it goes to the RS? St.Ack On Fri, Mar 6, 2015 at 4:46 PM, Demai Ni nid...@gmail.com wrote: hi, guys, I am trying to get a rough idea about the performance comparison

<    1   2   3   4   5   6   7   8   9   10   >