RE: zookeeper.znode.parent mismatch exception

2013-12-13 Thread Sandeep L
I checked zk dump from master UI, there all 5 zk servers are appearing with some stats. Not always we are getting this exception, only in random intervals we are seeing it. Thanks,Sandeep. From: bhara...@cloudera.com Date: Fri, 13 Dec 2013 13:10:52 +0530 Subject: Re: zookeeper.znode.parent

Reading the data from specified region

2013-12-13 Thread Syed Abdul Kather
Hi , Is there a way where i can read record in region directly? Example : If my table is splited into 8 region and i have 4 RS(Each has 2 region) . I have control on my Rowkey split. Now i need to read data directly from the Region and process [Data Locality]. I will send my jar to the

Re: Reading the data from specified region

2013-12-13 Thread Ted Yu
Take a look at https://blogs.apache.org/hbase/entry/coprocessor_introduction Cheers On Dec 13, 2013, at 5:38 AM, Syed Abdul Kather in.ab...@gmail.com wrote: Hi , Is there a way where i can read record in region directly? Example : If my table is splited into 8 region and i have 4

RE: Kundera 2.9 released

2013-12-13 Thread Vivek Mishra
Hi All, We are happy to announce the release of Kundera 2.9 . Kundera is a JPA 2.0 compliant, object-datastore mapping library for NoSQL datastores. The idea behind Kundera is to make working with NoSQL databases drop-dead simple and fun. It currently supports Cassandra, HBase, MongoDB,

Problems with hbase.hregion.max.filesize

2013-12-13 Thread Timo Schaepe
Hello, during the loading of data in our cluster I noticed some strange behavior of some regions, that I don't understand. Scenario: We convert data from a mysql database to HBase. The data is inserted with a put to the specific HBase table. The row key is a timestamp. I know the problem

Re: Problems with hbase.hregion.max.filesize

2013-12-13 Thread Timo Schaepe
Hello again, digging in the logs of the specific regionserver shows me that: 2013-12-12 13:54:20,194 INFO org.apache.hadoop.hbase.regionserver.SplitRequest: Running rollback/cleanup of failed split of data,OR\x83\xCF\x02\x82\xAE\xF3U,1386851456415.d04cadb1b2252dafc476c138e9651ca7.; Took too

Re: Problems with hbase.hregion.max.filesize

2013-12-13 Thread Jean-Marc Spaggiari
Try to increase hbase.regionserver.fileSplitTimeout but put it back to its default value after. Default value is 30 seconds. I think it's not normal for a split to take more than that. What is your hardware configuration? Have you run hbck to see if everything is correct? JM 2013/12/13 Timo

Re: Problems with hbase.hregion.max.filesize

2013-12-13 Thread Ted Yu
Timo: Can you pastebin regionserver log around 2013-12-12 13:54:20 so that we can see what happened ? Thanks On Fri, Dec 13, 2013 at 11:02 AM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Try to increase hbase.regionserver.fileSplitTimeout but put it back to its default value after.

Re: 3-Hour Periodic Network/CPU/Disk/Latency Spikes

2013-12-13 Thread Bryan Beaudreault
Have you taken a look at the logs on the RegionServers during the period? One possibility is compactions happening organically. If you were sustaining a certain level of writes most of the time, I could maybe see that every 3 hours enough store files build up to require compactions. There's

HBase Client

2013-12-13 Thread ados1...@gmail.com
Hello All, I am newbie in hbase and wanted to see if there are any good hbase client that i can use to query underlying hbase datastore or what is the best tool to use? I am using command line but looking for any other best alternative. Regards, Andy.

Re: HBase Client

2013-12-13 Thread Ted Yu
Hi, See http://hbase.apache.org/book.html#client and http://hbase.apache.org/book.html#rest Cheers On Fri, Dec 13, 2013 at 2:06 PM, ados1...@gmail.com ados1...@gmail.comwrote: Hello All, I am newbie in hbase and wanted to see if there are any good hbase client that i can use to query

Re: HBase Client

2013-12-13 Thread ados1...@gmail.com
Application view for data that is stored in Hbase...like toad or sql developer in case of rdbms. On Fri, Dec 13, 2013 at 5:09 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Hi Andy, By client, do you mean the client API so you can run code to work with the data? Or do you mean a

Re: HBase Client

2013-12-13 Thread ados1...@gmail.com
Thanks Ted but am looking for something like toad/sql developer for querying/viewing data in hbase. On Fri, Dec 13, 2013 at 5:09 PM, Ted Yu yuzhih...@gmail.com wrote: Hi, See http://hbase.apache.org/book.html#client and http://hbase.apache.org/book.html#rest Cheers On Fri, Dec 13, 2013

Re: HBase Client

2013-12-13 Thread Jean-Marc Spaggiari
Have you asked google first? ;) Take a look at: - Hue (Web interface with access to HDFS (flie browser) and HBase (table browser). http://gethue.tumblr.com/post/59071544309/the-web-ui-for-hbase-hbase-browser - HBaseExplorer you can find many others on google. I can send you more links if

Re: HBase Client

2013-12-13 Thread Ted Yu
Search for 'hbase sql client' gives this as top hit: https://github.com/forcedotcom/phoenix On Fri, Dec 13, 2013 at 2:14 PM, ados1...@gmail.com ados1...@gmail.comwrote: Thanks Ted but am looking for something like toad/sql developer for querying/viewing data in hbase. On Fri, Dec 13, 2013

Re: HBase Client

2013-12-13 Thread Manikanda Prabhu
Just check for hue Sent from my iPhone On Dec 13, 2013, at 5:14 PM, ados1...@gmail.com ados1...@gmail.com wrote: Thanks Ted but am looking for something like toad/sql developer for querying/viewing data in hbase. On Fri, Dec 13, 2013 at 5:09 PM, Ted Yu yuzhih...@gmail.com wrote:

Re: HBase Client

2013-12-13 Thread ados1...@gmail.com
Thank you Ted and Jean, I should have been more clear stating what is the best hbase client to use with *mapR*? Hue is not officially supported with mapR. On Fri, Dec 13, 2013 at 5:16 PM, Ted Yu yuzhih...@gmail.com wrote: Search for 'hbase sql client' gives this as top hit:

Re: HBase Client

2013-12-13 Thread Jean-Marc Spaggiari
Hi Andy, Then I'm not really sure what to recommend you. What version of HBase are you using with your mapR distribution? 0.94.x? 0.92.x? JM 2013/12/13 ados1...@gmail.com ados1...@gmail.com Thank you Ted and Jean, I should have been more clear stating what is the best hbase client to use

Re: HBase Client

2013-12-13 Thread ados1...@gmail.com
Am using MapR M7 HBase distribution ( http://www.mapr.com/products/mapr-editions/m7-edition) On Fri, Dec 13, 2013 at 5:24 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Hi Andy, Then I'm not really sure what to recommend you. What version of HBase are you using with your mapR

Re: HBase Client

2013-12-13 Thread Gary Helmling
Hi Andy, I'm afraid you will have to ask MapR then what is supported. MapR M7 is a proprietary application. It is _not_ Apache HBase. On Fri, Dec 13, 2013 at 2:27 PM, ados1...@gmail.com ados1...@gmail.comwrote: Am using MapR M7 HBase distribution (

Re: HBase Client

2013-12-13 Thread Jean-Marc Spaggiari
Hi Andy, Sorry, I don't want to say anything wrong, but I think this is not really HBase. It's something working like HBase, doing almost the same things, but not 100% the same. So I'm not sure I can recommend any tool working with it. You might want to ask to a M7 mailing list if they have

Re: HBase Client

2013-12-13 Thread ados1...@gmail.com
Thank you all. I will try to reach them and ask about it. On Fri, Dec 13, 2013 at 5:30 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Hi Andy, Sorry, I don't want to say anything wrong, but I think this is not really HBase. It's something working like HBase, doing almost the same

Re: HBase Client

2013-12-13 Thread ados1...@gmail.com
Any one having experience with HRider tool? Is it good or do we have better solutions than that in HBase eco system? On Fri, Dec 13, 2013 at 5:33 PM, ados1...@gmail.com ados1...@gmail.comwrote: Thank you all. I will try to reach them and ask about it. On Fri, Dec 13, 2013 at 5:30 PM,

Re: HBase Client

2013-12-13 Thread Jean-Marc Spaggiari
I played with is a bit. It was working pretty well. JM 2013/12/13 ados1...@gmail.com ados1...@gmail.com Any one having experience with HRider tool? Is it good or do we have better solutions than that in HBase eco system? On Fri, Dec 13, 2013 at 5:33 PM, ados1...@gmail.com

Re: HBase Client

2013-12-13 Thread Kevin O'dell
It depends, are you looking for a GUI interface to HBase? In the HBase ecosystem we have tons of great tools. HappyBase Java API Phoenix etc HRider is a good tool as well. Try them all and pick whichever one makes you happy. I have NO CLUE if any of those will work with M7 though...again I

Re: HBase Client

2013-12-13 Thread ados1...@gmail.com
Ah...i wish every company's support would be as responsive as *opensource community*...sigh !!! Thanks Kevin all...i will give it all a shot...wondering about Phoenix, taking quick look at it...looks like they take in SQL statements and generate hbase queries...not sure how efficiently they are

Re: HBase Client

2013-12-13 Thread Jean-Marc Spaggiari
Don't use Phoenix, it's a very bad idea... ;) No, I'm joking. Phoenix will allow you to run SQL on HBase. After that, I guess you can use any SQL editor and connect it, but I'm not sure. It's working very well for what it's doing. However, Pheonix is tightly linked to HBase. You odds to get it

Re: HBase Client

2013-12-13 Thread ados1...@gmail.com
Hmmm...i agree...as suggested, i would circle back with mapR vendor to get proper information on what would work with their solutions but good to know about phoenix !!! On Fri, Dec 13, 2013 at 5:49 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Don't use Phoenix, it's a very bad

Re: 3-Hour Periodic Network/CPU/Disk/Latency Spikes

2013-12-13 Thread Patrick Schless
Very interesting, I think we may be on to something. I grabbed all the timestamps for major compactions completing and put them on a graph (see attached). Each horizontal line is an individual server, and the dots are when compactions complete. Each server clearly has a cluster of compactions

Re: 3-Hour Periodic Network/CPU/Disk/Latency Spikes

2013-12-13 Thread Ted Yu
Patrick: Attachment didn't go through. Cheers On Dec 13, 2013, at 3:18 PM, Patrick Schless patrick.schl...@gmail.com wrote: Very interesting, I think we may be on to something. I grabbed all the timestamps for major compactions completing and put them on a graph (see attached). Each

[ANNOUNCE] Phoenix accepted as Apache incubator

2013-12-13 Thread James Taylor
The Phoenix team is pleased to announce that Phoenix[1] has been accepted as an Apache incubator project[2]. Over the next several weeks, we'll move everything over to Apache and work toward our first release. Happy to be part of the extended family. Regards, James [1]

Re: [ANNOUNCE] Phoenix accepted as Apache incubator

2013-12-13 Thread Ted Yu
Congratulations, James. On Fri, Dec 13, 2013 at 3:50 PM, James Taylor jtay...@salesforce.comwrote: The Phoenix team is pleased to announce that Phoenix[1] has been accepted as an Apache incubator project[2]. Over the next several weeks, we'll move everything over to Apache and work toward

RE: 3-Hour Periodic Network/CPU/Disk/Latency Spikes

2013-12-13 Thread Vladimir Rodionov
You forgot to mention that it won't go through because Apache mail server blocks attachments. What Patrick is observing is called compaction storms. The best way (as since its 0.92.x) is to disable automatic compactions and manage them manually (see HBase book how to do this). Best regards,

Re: 3-Hour Periodic Network/CPU/Disk/Latency Spikes

2013-12-13 Thread Patrick Schless
Ah, sorry about the attachment (didn't realize they weren't allowed). Here's the picture I was trying to attach: http://www.plainlystated.com/hbase_major_compactions.png It sounds like you're right, Vladimir, about the compaction storm, though I don't understand why it's about every three hours

RE: 3-Hour Periodic Network/CPU/Disk/Latency Spikes

2013-12-13 Thread Vladimir Rodionov
Available HBase API allows to compact table's regions independently. It can be cron job, script or client application which connects to HBase cluster, selects regions and trigger compaction, but you have to write this piece of software yourself. Best regards, Vladimir Rodionov Principal Platform

Re: [ANNOUNCE] Phoenix accepted as Apache incubator

2013-12-13 Thread Jean-Marc Spaggiari
Nice. Congratulation James. I might really have to give it a try one day... ;) 2013/12/13 Ted Yu yuzhih...@gmail.com Congratulations, James. On Fri, Dec 13, 2013 at 3:50 PM, James Taylor jtay...@salesforce.com wrote: The Phoenix team is pleased to announce that Phoenix[1] has been

Re: [ANNOUNCE] Phoenix accepted as Apache incubator

2013-12-13 Thread rajesh babu Chintaguntla
Nice. Congratulations James. On Sat, Dec 14, 2013 at 7:28 AM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Nice. Congratulation James. I might really have to give it a try one day... ;) 2013/12/13 Ted Yu yuzhih...@gmail.com Congratulations, James. On Fri, Dec 13, 2013 at

Re: Reading the data from specified region

2013-12-13 Thread Syed Abdul Kather
Hi Ted , Thanks for your reply . But I don't want to use coprocessor . Is there a way where I can read data via our custom jar Like : Region obj = new Region ( Region name ) Obj.read() ; Thanks Syed On Dec 13, 2013 8:36 PM, Ted Yu yuzhih...@gmail.com wrote: Take a look at

Re: Reading the data from specified region

2013-12-13 Thread Jean-Marc Spaggiari
Hi Syed, What is you goal? Do you want to read all the entries for this region and process them? Or you want to get a specific entry on this region? Or you want to process all the regions, but make sure you are doing that locally to the region server? For 1: You a scan using the region

Undefined table and DoNotRetryIOException errors when accessed from phoenix

2013-12-13 Thread mathan kumar
Hi All, Created a table (MyTable) in hbase and added data to it and then tried to access through phoenix client. Got exception due to query bug while creating virtual table with the same name(MyTable). But found that the table got created though exception occurred. Could not access or alter or

Re: Undefined table and DoNotRetryIOException errors when accessed from phoenix

2013-12-13 Thread Ted Yu
Phoenix has its own mailing list. On Fri, Dec 13, 2013 at 9:24 PM, mathan kumar immathanku...@gmail.comwrote: Hi All, Created a table (MyTable) in hbase and added data to it and then tried to access through phoenix client. Got exception due to query bug while creating virtual table with

Re: Undefined table and DoNotRetryIOException errors when accessed from phoenix

2013-12-13 Thread mathan kumar
sent to Phoenix mailing list and got the reply to check with HBase users On Sat, Dec 14, 2013 at 10:59 AM, Ted Yu yuzhih...@gmail.com wrote: Phoenix has its own mailing list. On Fri, Dec 13, 2013 at 9:24 PM, mathan kumar immathanku...@gmail.com wrote: Hi All, Created a table