Re: Multi-CheckAnd...

2013-04-27 Thread Ted Yu
I think we can utilize HBASE-6712 for this work. Cheers On Sun, Apr 28, 2013 at 11:34 AM, lars hofhansl wrote: > It's not far fetched to add a checkAndMutate method/rpc to HBase. Put, > Delete, Increment (in trunk), and Append extend Mutation, s

Re: HBase and Semantic Integration

2013-04-27 Thread Amandeep Khurana
Seems like you mean establishing relationships between different columns like relational databases allow. That would surely be desirable for applications but the idea behind HBase (and other NoSQL systems) is to give up sophisticated features to accomplish easier and higher scalability. On Apr 27,

HBase and Datawarehouse

2013-04-27 Thread Kiran
What is the difference between a NoSQL database like HBase and a data warehouse? Doesn’t both store data from disparate sources and formats? -- View this message in context: http://apache-hbase.679495.n3.nabble.com/HBase-and-Datawarehouse-tp4043172.html Sent from the HBase User mailing list arc

Re: Multi-CheckAnd...

2013-04-27 Thread lars hofhansl
It's not far fetched to add a checkAndMutate method/rpc to HBase. Put, Delete, Increment (in trunk), and Append extend Mutation, so it would not be too hard to add. Could you file a jira and explain what you need specifically. I'm sure somebody will step up and make a patch (unless you want to w

Re: Dual Hadoop/HBase configuration through same client

2013-04-27 Thread Michael Segel
This was answered on the linkedIn HBase discussion group. Create two configuration instances and then have each one point to the cluster you want to connect to. Then when you create an instance of HTable you use the correct configuration. HTH -Mike On Apr 27, 2013, at 12:20 AM, Shahab Yunu

Re: Dual Hadoop/HBase configuration through same client

2013-04-27 Thread Shahab Yunus
You are right as it is not a proper strategy to try to connect a secure cluster with a non-secure one. We were just trying to see that if somehow we can connect those without changing the current security configurations of these existing clusters, but I guess not. Thanks for your input and replies.

Re: Multi-CheckAnd...

2013-04-27 Thread Ted Yu
In the API you described, what is the meaning for first parameter, row ? Are the puts allowed to write into rows with row keys other than that specified by row ? I am asking because potentially the rowkey range implied by puts may span beyond one region. If that is the case, HBase doesn't support

Re: Dual Hadoop/HBase configuration through same client

2013-04-27 Thread Ted Yu
Shahab: Can you enable Kerberos-based security in the other cluster ? Exporting information from secure cluster to insecure cluster doesn't seem right. Cheers On Sun, Apr 28, 2013 at 12:54 AM, Shahab Yunus wrote: > Interesting lead, thanks. > > Meanwhile, I was also thinking of using distcp. Wi

Re: checkAnd...

2013-04-27 Thread Ted Yu
It would be nice to know a bit more about your schema. How many tables do you use in the scenario you described ? One for user (counter), one for event ? Or just one table for all related information ? bq. to have an event_id qualifier for each incoming event Would you store the event_id informa

Re: HBase and Semantic Integration

2013-04-27 Thread Amandeep Khurana
+user@ moving dev@ to bcc Kiran Can you elaborate on what you mean by semantic integration? Also, this question is more relevant for the user mailing list than the dev list. Amandeep On Apr 27, 2013, at 3:13 PM, Kiran wrote: > We can use HBase as a storage back end for big-data.Can you thin

Re: Dual Hadoop/HBase configuration through same client

2013-04-27 Thread Shahab Yunus
Interesting lead, thanks. Meanwhile, I was also thinking of using distcp. With the help of hftp we can overcome the Hadoop mismatch issue as well but I think the mismatch in security configuration will still be a problem. I tried it as the following, where the source has Kerberos configured and th

Multi-CheckAnd...

2013-04-27 Thread Em
Hello list, I was wondering how to create a multi-row-mutation with precondition-constraints. Something like this: public boolean[] multiCheckAndPut(byte[]row, byte[] family, byte[] column, List puts); This looks a little bit ugly but illustrates the idea. Are there any alternatives that would

Re: checkAnd...

2013-04-27 Thread Lior Schachter
found the checkAndIncrement Jira - HBASE-6712 . Would be nice to have also checkandAppend. Any ideas how to solve to the use case I described ? On Sat, Apr 27, 2013 at 4:46 PM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > Hi Ted, > >

Re: checkAnd...

2013-04-27 Thread Jean-Marc Spaggiari
Hi Ted, Will it be a good idea to add it? Should we open a JIRA and implement checkANDIncrement? Might be pretty simple. JM 2013/4/27 Ted Yu : > Take a look at the following method in HRegionServer: > > public boolean checkAndPut(final byte[] regionName, final byte[] row, > final byte[]

Re: checkAnd...

2013-04-27 Thread Lior Schachter
Hi Ted, Thanks for the prompt response. I've already had a look at HRegionServer.checkAndPut and the implementation looks quite straight forward. That's why I was wondering why the other 2 methods are not available...or planned (couldn't find Jira). Seems like a useful functionality. Anyhow, I'm n

Re: checkAnd...

2013-04-27 Thread Ted Yu
Take a look at the following method in HRegionServer: public boolean checkAndPut(final byte[] regionName, final byte[] row, final byte[] family, final byte[] qualifier, final byte[] value, final Put put) throws IOException { You can create checkAndIncrement() in a similar way. Chee

checkAnd...

2013-04-27 Thread Lior Schachter
Hi, I want to increment a cell value only after checking a condition on another cell. I could find checkAndPut/checkAndDelete on HTableInteface. It seems that checkAndIncrement (and checkAndAppend) are missing. Can you suggest a workaround for my use-case ? working with version 0.94.5. Thanks, L