How to update a record in hbase

2012-09-13 Thread Ramasubramanian
Hi, Can we update a particular record in hbase? If we can pls help in sharing the command. Regards, Rams

Re: How to update a record in hbase

2012-09-13 Thread lars hofhansl
Nothing is updated in place in HBase. All write operation create new versions. Have a look at this: http://hbase.apache.org/book.html#datamodel - Original Message - From: Ramasubramanian ramasubramanian.naraya...@gmail.com To: user@hbase.apache.org Cc: Sent: Wednesday, September 12,

Re: How to update a record in hbase

2012-09-13 Thread Elliott Clark
HTable is the usual java interface to interact with a table in HBase. You can see the api for that here: http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/client/HBaseAdmin.html The Ref guide has a more comprehensive overview of the client here: http://hbase.apache.org/book/client.html On

Re: How to update a record in hbase

2012-09-13 Thread samar kumar
You can use the shell too http://wiki.apache.org/hadoop/Hbase/Shell Update is again a put. Incase of multiple version support the older values could be retained. Regards, Samar On 13/09/12 12:04 PM, Elliott Clark ecl...@stumbleupon.com wrote: HTable is the usual java interface to interact with

Re: HBASE garbage collection problem

2012-09-13 Thread samar kumar
You might find it along with your hbase log files. The file name would be same as your other log file except that it would be a .out file. Regards, Samar On 13/09/12 10:18 AM, Xiang Hua bea...@gmail.com wrote: hi, where can i fidn the GC log? I am a newcomer. Thanks! beatls On Wed,

Re: HBASE garbage collection problem

2012-09-13 Thread Xiang Hua
Hi, pls give some advice for adding a datanode. can we add a datanode without shutdown cluster. Thanks! beatls

Re: HBASE garbage collection problem

2012-09-13 Thread Xiang Hua
yes, region server is included. as well as datanode. On Thu, Sep 13, 2012 at 4:50 PM, samar kumar samar.opensou...@gmail.comwrote: Do you mean Region server?? On 13/09/12 2:04 PM, Xiang Hua bea...@gmail.com wrote: Hi, pls give some advice for adding a datanode. can we add a datanode

Re: Hbase Scan - number of columns make the query performance way different

2012-09-13 Thread Doug Meil
Hi there, I don't know the specifics of your environment, but ... http://hbase.apache.org/book.html#perf.reading 11.8.2. Scan Attribute Selection Š describes paying attention to the number of columns you are returning, particularly when using HBase as a MR source. In short, returning only the

Re: Hbase Scan - number of columns make the query performance way different

2012-09-13 Thread Shengjie Min
In my case, I am not feeding hbase result to mapred, it's just pure hbase scan, returning all columns vs two columns makes huge difference to me. On 13 September 2012 15:29, Doug Meil doug.m...@explorysmedical.com wrote: Hi there, I don't know the specifics of your environment, but ...

Re: Hbase Scan - number of columns make the query performance way different

2012-09-13 Thread Jacques
Not sure of your schema... Each column family is in a separate collection of StoreFiles. Scan all will read all these files whereas your second scan will only read the StoreFiles associated with column family cf (difference if you have multiple column families). Additionally, pushing a large

Was HBASE-3817 really fixed? (HBase Shell has an issue accepting FILTER for the 'scan' command.)

2012-09-13 Thread Shumin Wu
Hi, I saw an issue about using filter in scan on shell was reported as fixed in version 0.92.0 from (https://issues.apache.org/jira/browse/HBASE-3817), but it seems using a filter still makes the hbase shell disfunctioning in 0.92.1. Can anyone else reproduce this issue? Script to reproduce

User meetup on 10/29?

2012-09-13 Thread Stack
The folks at wizecommerce have kindly offered to host a meetup down in San Mateo on the evening of 10/29. Are you all up for a user meetup at the end of October after Hadoop World? If so, I'll stick it up in meetup. If you are interested in presenting, write me off list and we'll get you signed

ANN: hbase-0.92.2 is available for download

2012-09-13 Thread Ted Yu
Your HBase team are pleased to announce the release of HBase 0.92.2. Download it from your favorite Apache mirror [1]. I am trying to push the artifacts to maven repo. HBase 0.92.2 is a bug fix release. For a complete list of changes, see the release notes [2]. If upgrading from 0.90.x to

Re: HBase aggregate query

2012-09-13 Thread James Taylor
No, there's no sorted dimension. This would be a full table scan over 40M rows. This assumes the following: 1) your regions are evenly distributed across a four node cluster 2) unique combinations of month * scene are small enough to fit into memory 3) you chunk it up on the client side and run

replication - how do I know the status?

2012-09-13 Thread Neil Yalowitz
Hi all, I'm using HBase replication between two clusters running CDH3u3 and I recently noticed that a replicated column family was lagging by more than a day... that is, it required more than 24 hours for a Put to replicate from master to slave. The root cause of the lag appears to be swapping

Re: ANN: hbase-0.92.2 is available for download

2012-09-13 Thread Jean-Daniel Cryans
On Thu, Sep 13, 2012 at 11:44 AM, Ted Yu yuzhih...@gmail.com wrote: https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12319888styleName=HtmlprojectId=12310753https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753version=12318551 Of those two links, one is 0.92.2

Re: replication - how do I know the status?

2012-09-13 Thread Jean-Daniel Cryans
The best metric at the moment is hbase.replication.sizeOfLogQueue published through JMX. If your have Ganglia, opentsdb or Cacti you can graph how many logs per server need to be replicated and then you'll have a good idea of how much data needs to be replicated. If it goes up to more than 2 per

Re: replication - how do I know the status?

2012-09-13 Thread Neil Yalowitz
This is a great answer, I can see that particular ganglia metric sharply increased when the issue began. Thanks much. One followup question: Can a distressed slave cluster cause performance issues on the master cluster? It appears our performance problem was occurring on the slave peer, but

Re: ANN: hbase-0.92.2 is available for download

2012-09-13 Thread Ted Yu
Thanks for pointing out J-D. On Thu, Sep 13, 2012 at 2:05 PM, Jean-Daniel Cryans jdcry...@apache.orgwrote: On Thu, Sep 13, 2012 at 11:44 AM, Ted Yu yuzhih...@gmail.com wrote: https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12319888styleName=HtmlprojectId=12310753

Can not access HBase Shell.

2012-09-13 Thread Jason Huang
Hello, I am trying to set up HBase at pseudo-distributed mode on my Macbook. I was able to installed hadoop and HBase and started the nodes. $JPS 5417 TaskTracker 5083 NameNode 5761 HRegionServer 5658 HMaster 6015 Jps 5613 HQuorumPeer 5171 DataNode 5327 JobTracker 5262 SecondaryNameNode

Re: Can not access HBase Shell.

2012-09-13 Thread Marcos Ortiz
Regards, Jason. Answers in line On 09/13/2012 06:42 PM, Jason Huang wrote: Hello, I am trying to set up HBase at pseudo-distributed mode on my Macbook. I was able to installed hadoop and HBase and started the nodes. $JPS 5417 TaskTracker 5083 NameNode 5761 HRegionServer 5658 HMaster 6015 Jps

Re: Can not access HBase Shell.

2012-09-13 Thread Xiang Hua
Hi, not root user can not find all the hadoop process. 1. root use find all the process, below: [root@hadoop1 ~]# jps 17452 SecondaryNameNode 18266 Main 7759 Jps 32095 QuorumPeerMain 17108 JobTracker 16955 TaskTracker 17566 HMaster 17177 NameNode 17765 HRegionServer 19424 ThriftServer

Re: nonroot user can not find all the hadoop process

2012-09-13 Thread Jean-Daniel Cryans
From jps' man page: DESCRIPTION The jps tool lists the instrumented HotSpot Java Virtual Machines (JVMs) on the target system. The tool is limited to reporting information on JVMs for which it has the access permissions. So normally it only shows you your own processes if you're

0.92 client fail to log in when using JNI

2012-09-13 Thread Lu, Wei
Hi, When I use C++ to call 0.92 HBase java APIs, it failed to log in. I tried similar operation by directly using Java Api, and they succeed. So, is there any difference between using java api through JNI with directly calling the same java api?? Can anyone help me out? Thank you very much.

Re: 0.92 client fail to log in when using JNI

2012-09-13 Thread Stack
CLASSPATH issue? Says: unable to find LoginModule class: org/apache/hadoop/security/UserGroupInformation$HadoopLoginModule St.Ack On Thu, Sep 13, 2012 at 8:50 PM, Lu, Wei w...@microstrategy.com wrote: Hi, When I use C++ to call 0.92 HBase java APIs, it failed to log in. I tried similar

Re: User meetup on 10/29?

2012-09-13 Thread Arati !
Hi Stack, Do you have similar meets anywhere in India? Bangalore maybe? Thanks, Arati On Thu, Sep 13, 2012 at 11:14 PM, Stack st...@duboce.net wrote: The folks at wizecommerce have kindly offered to host a meetup down in San Mateo on the evening of 10/29. Are you all up for a user meetup