Re: sqoop import into secure Hbase with kerberos

2013-08-06 Thread anil gupta
In addition to Gary's suggestion. Try to scan _acl_ table and check that kuser1 should have proper permissions. I haven't used Sqoop for loading data directly into HBase. But, i have used MR to load data into HBase. So, you might have to look at the way the MR job from sqoop is set-up. These two

scan very slow in hbase

2013-08-06 Thread ch huang
my workmate tell me hbase is very slow for scan something ,i check the region server find the following information,anyone can help? 13/08/06 15:30:34 WARN ipc.HBaseServer: IPC Server listener on 60020: readAndProcess threw exception java.io.IOException: Connection reset by peer. Count of bytes

how to import data from other table?

2013-08-06 Thread ch huang
i have a hbase table t1 , i want get 2013-08-01 00:00:00 data ,and put into another table ,how to do it ? anyone can help?

Re: how to import data from other table?

2013-08-06 Thread Matteo Bertozzi
You can use CopyTable with the specified start time take a look at the copyTable documentation for more information http://hbase.apache.org/book/ops_mgt.html#copytable Matteo On Tue, Aug 6, 2013 at 10:23 AM, ch huang justlo...@gmail.com wrote: i have a hbase table t1 , i want get 2013-08-01

Re: FileNotFound Exception while ExportSnapshot

2013-08-06 Thread Siddharth Karandikar
Fixed the subject. On Tue, Aug 6, 2013 at 3:55 PM, Siddharth Karandikar siddharth.karandi...@gmail.com wrote: Hi All, I am continuing to tryout ExportSnapshot functionality. Most of the time it works perfectly fine. But recently, I am seeing some strange exception. When I run

Re: FileNotFound Exception while ExportSnapshot

2013-08-06 Thread Matteo Bertozzi
This looks like HBASE-8455 which was fixed in 0.94.8, 0.95.2 Matteo On Tue, Aug 6, 2013 at 11:26 AM, Siddharth Karandikar siddharth.karandi...@gmail.com wrote: Fixed the subject. On Tue, Aug 6, 2013 at 3:55 PM, Siddharth Karandikar siddharth.karandi...@gmail.com wrote: Hi All, I

Re: FileNotFound Exception while ExportSnapshot

2013-08-06 Thread Siddharth Karandikar
You are correct. Exception is gone after switching to 0.94.10. Thanks a lot! - Siddharth On Tue, Aug 6, 2013 at 3:59 PM, Matteo Bertozzi theo.berto...@gmail.com wrote: This looks like HBASE-8455 which was fixed in 0.94.8, 0.95.2 Matteo On Tue, Aug 6, 2013 at 11:26 AM, Siddharth

Re: Puppetized HBASE + Passwordless SSH examples

2013-08-06 Thread Artem Ervits
Check out apache ambari, it uses Puppet to deploy and manage HBase and other apps. Artem Ervits Data Analyst New York Presbyterian Hospital - Original Message - From: Jay Vyas [mailto:jayunit...@gmail.com] Sent: Monday, August 05, 2013 10:52 AM To: user@hbase.apache.org

Re: Elastic Search Plugin (River) for HBase

2013-08-06 Thread Bruno Dumon
Hi, Interesting, we did a similar thing for indexing HBase content into Solr, you can find it here: https://github.com/NGDATA/hbase-indexer The part which picks up on the HBase replication stream is available as standalone library: https://github.com/NGDATA/hbase-indexer/tree/master/hbase-sep

Re: scan very slow in hbase

2013-08-06 Thread Stack
I would suggest you search the mail archives before posting first (you will usually get your answer faster if you go this route). The below has been answered in the recent past. See http://search-hadoop.com/m/5tk8QnhFqw Thanks, St.Ack On Tue, Aug 6, 2013 at 12:39 AM, ch huang

NoRouteToHostException when zookeeper crashes

2013-08-06 Thread Dhaval Shah
I have a weird (and a pretty serious) issue on my HBase cluster. Whenever one of my zookeeper server goes down, already running services work fine for a few hours but when I try to restart any service (be it region servers or clients), they fail with a NoRouteToHostException while trying to

Re: Elastic Search Plugin (River) for HBase

2013-08-06 Thread Stack
On Tue, Aug 6, 2013 at 7:42 AM, Bruno Dumon br...@ngdata.com wrote: Hi, Interesting, we did a similar thing for indexing HBase content into Solr, you can find it here: https://github.com/NGDATA/hbase-indexer The part which picks up on the HBase replication stream is available as

Re: NoRouteToHostException when zookeeper crashes

2013-08-06 Thread Ted Yu
What HBase / zookeeper versions are you using ? On Tue, Aug 6, 2013 at 7:48 AM, Dhaval Shah prince_mithi...@yahoo.co.inwrote: I have a weird (and a pretty serious) issue on my HBase cluster. Whenever one of my zookeeper server goes down, already running services work fine for a few hours but

Re: NoRouteToHostException when zookeeper crashes

2013-08-06 Thread Dhaval Shah
HBase - 0.92.1 Zookeeper - 3.4.3   Regards, Dhaval - Original Message - From: Ted Yu yuzhih...@gmail.com To: user@hbase.apache.org; Dhaval Shah prince_mithi...@yahoo.co.in Cc: Sent: Tuesday, 6 August 2013 11:08 AM Subject: Re: NoRouteToHostException when zookeeper crashes What HBase /

Re: NoRouteToHostException when zookeeper crashes

2013-08-06 Thread Ted Yu
bq. one of my zookeeper server goes down How many servers were left in the quorum ? Was the new leader elected properly afterwards ? Thanks On Tue, Aug 6, 2013 at 8:18 AM, Dhaval Shah prince_mithi...@yahoo.co.inwrote: HBase - 0.92.1 Zookeeper - 3.4.3 Regards, Dhaval - Original

Re: Puppetized HBASE + Passwordless SSH examples

2013-08-06 Thread Jeremy Carroll
I have some modules that I developed for Pinterest if you are looking for a head start. LMK if you would be interested. On Tue, Aug 6, 2013 at 6:03 AM, Artem Ervits are9...@nyp.org wrote: Check out apache ambari, it uses Puppet to deploy and manage HBase and other apps. Artem Ervits Data

Re: Puppetized HBASE + Passwordless SSH examples

2013-08-06 Thread Jay Vyas
thanks .. ! well there certainly are a few customized ones on github but they are varying degrees of maintainance. i gather from this thread that no generic and accepted puppetization of hbase has been created in the community. maybe a jira ? On Tue, Aug 6, 2013 at 11:35 AM, Jeremy Carroll

Re: Puppetized HBASE + Passwordless SSH examples

2013-08-06 Thread Asaf Mesika
We have also developed a fabric customization for HBase stack and all our components. Anyone had experience with Ambari relative to Fabric? On Tuesday, August 6, 2013, Jay Vyas wrote: thanks .. ! well there certainly are a few customized ones on github but they are varying degrees of

Re: Elastic Search Plugin (River) for HBase

2013-08-06 Thread Asaf Mesika
Cool! Do you guys store your data twice then? Once on HBase and another on ES? And then add index data? On Tuesday, August 6, 2013, Alex Newman wrote: Based on the previous work using async libraries to index HBase into elastic search, I've created.

Re: HDFS Restart with Replication

2013-08-06 Thread Patrick Schless
Hi J-D, Thanks for the help. I tried your suggestion (hbase-daemon.sh stop master), and this leaves all the region servers running. This seems the same as the problematic case I was in when I was stopping only the HMaster, and not the region servers, and then bouncing HDFS. It seems like I want

Re: scan very slow in hbase

2013-08-06 Thread lars hofhansl
In addition to that, make sure you have scanner caching enabled (Scan.setCaching). By default (in 0.94) every call to scanner.next() causes its own RPC request. -- Lars From: Stack st...@duboce.net To: Hbase-User user@hbase.apache.org Sent: Tuesday, August

Re: Elastic Search Plugin (River) for HBase

2013-08-06 Thread Alex Newman
Asaf, In our case yes. If you don't count all of the replication, we store the data twice. On Tue, Aug 6, 2013 at 9:00 AM, Asaf Mesika asaf.mes...@gmail.com wrote: Cool! Do you guys store your data twice then? Once on HBase and another on ES? And then add index data? On Tuesday, August 6,

Re: NoRouteToHostException when zookeeper crashes

2013-08-06 Thread Stack
On Tue, Aug 6, 2013 at 7:48 AM, Dhaval Shah prince_mithi...@yahoo.co.inwrote: I have a weird (and a pretty serious) issue on my HBase cluster. Whenever one of my zookeeper server goes down, already running services work fine for a few hours but when I try to restart any service (be it region

Re: sqoop import into secure Hbase with kerberos

2013-08-06 Thread ssatish
Thanks for your suggestions. I was able to successfully scan tables from the hbase side. So there's no problem in hbase kerberos configuration. Sqoop is not picking up the correct kerberos credentials. Scan _acl_ also worked - demo column=l:kuser1,

Re: NoRouteToHostException when zookeeper crashes

2013-08-06 Thread Dhaval Shah
Thanks Stack. Do you have any specific pointers as to what configs would help mitigate this issue with a DHCP setup (I am not a networking expert, other teams manage the network and if I have specific pointers that would help guide the discussion)   Regards, Dhaval

Re: NoRouteToHostException when zookeeper crashes

2013-08-06 Thread Stack
On Tue, Aug 6, 2013 at 10:41 AM, Dhaval Shah prince_mithi...@yahoo.co.inwrote: Thanks Stack. Do you have any specific pointers as to what configs would help mitigate this issue with a DHCP setup (I am not a networking expert, other teams manage the network and if I have specific pointers that

Re: scan very slow in hbase

2013-08-06 Thread ch huang
i find the error is because i stop the running java code,i have not found why the scan is so slow On Tue, Aug 6, 2013 at 10:38 PM, Stack st...@duboce.net wrote: I would suggest you search the mail archives before posting first (you will usually get your answer faster if you go this route).

Re: scan very slow in hbase

2013-08-06 Thread ch huang
i set the cache still no help ,here is my code HTable table = new HTable(conf, tablename); Scan scan = new Scan(); scan.setTimeRange(NumberUtils.toLong(1369108800515), NumberUtils.toLong(1369108810515)); scan.setCaching(1); System.out.println(start

Re: scan very slow in hbase

2013-08-06 Thread Azuryy Yu
Try to set scan cache to 200. and what size of your block cache? did you check the GC log during slow scan? On Wed, Aug 7, 2013 at 9:20 AM, ch huang justlo...@gmail.com wrote: i set the cache still no help ,here is my code HTable table = new HTable(conf, tablename); Scan

Fwd: scan very slow in hbase

2013-08-06 Thread Marcos Luis Ortiz Valmaseda
Regards, ch. Which version of HBase are you using? HBase´s development group have worked very hard in Scans improvements http://www.slideshare.net/cloudera/hbase-consistency-and-performance-finalhttp://es.slideshare.net/cloudera/hbase-consistency-and-performance-final

Re: scan very slow in hbase

2013-08-06 Thread Marcos Luis Ortiz Valmaseda
Regards, ch. I was looking a post about this topic and I found it. It was posted in the Ericsson Labs´s blog, and it talked about the approach they followed to improve HBase performance in several ways, including Scans. You can read it here: http://labs.ericsson.com/blog/hbase-performance-tuners

Re: HDFS Restart with Replication

2013-08-06 Thread Asaf Mesika
Yep. That's a confusing one. When running /hbase stop master, it sets the shutdown flag in ZK. RS listen in on this flag, and once they see it set, they shut them selfs down. Once they are all down, the master goes down as well. On Saturday, August 3, 2013, Jean-Daniel Cryans wrote: Ah then