Re: HBase Block locality always 0

2015-05-13 Thread Dima Spivak
Have you seen Esteban's suggestion? Another possibility is that a number of old JIRAs covered the fact that regions were assigned in a silly way when a table was disabled and then enabled. Could this be the case for you? -Dima On Wed, May 13, 2015 at 8:36 PM, 娄帅 louis.hust...@gmail.com wrote:

Re: HBase and Thrift Configuration

2015-05-04 Thread Dima Spivak
Hi Ankush, To begin, which version of HBase are you running? Are you asking about how to generate Thrift bindings? If so, a good resource to begin with is http://blog.cloudera.com/blog/2013/09/how-to-use-the-hbase-thrift-interface-part-1/ . All the best, Dima On Mon, May 4, 2015 at 12:32 PM,

Re: Hbase and Thrift configuration

2015-05-04 Thread Dima Spivak
Hi Ankush, To begin, which version of HBase are you running? Are you asking about how to generate Thrift bindings? If so, a good resource to begin with is http://blog.cloudera.com/blog/2013/09/how-to-use-the-hbase-thrift-interface-part-1/ . All the best, Dima On Mon, May 4, 2015 at 2:22 PM,

Re: [ANNOUNCE] Apache HBase 1.0.0 is now available for download

2015-02-24 Thread Dima Spivak
Hoo! -Dima On Tue, Feb 24, 2015 at 9:46 AM, Gary Helmling ghelml...@gmail.com wrote: Fantastic work! Congrats everyone! On Tue Feb 24 2015 at 9:45:24 AM Esteban Gutierrez este...@cloudera.com wrote: Wow! Congrats, all! -- Cloudera, Inc. On Tue, Feb 24, 2015 at 9:41 AM, Jerry

Re: Connecting to HBase with Kerberos

2015-02-11 Thread Dima Spivak
Hey Jiten, Have you followed the steps outlined in http://hbase.apache.org/book.html#hbase.secure.configuration ? What issues are you seeing? -Dima On Wed, Feb 11, 2015 at 12:49 PM, Jiten Gore ji...@gores.net wrote: We are having difficulties connecting with our Java application to our

Re: HBase Compaction Issues

2015-02-02 Thread Dima Spivak
Hey Joseph, I suspect you're hitting hotspotting (see http://hbase.apache.org/book.html#rowkey.design). Moving forward, you might want to consider something like OpenTSDB for your time series data. -Dima On Mon, Feb 2, 2015 at 1:18 AM, joseph jose...@arssoftware.com wrote: Hi, We are

Re: i want to subscribe

2015-01-30 Thread Dima Spivak
Please email user-subscr...@hbase.apache.org -Dima On Fri, Jan 30, 2015 at 7:35 AM, wangyongqiang0...@163.com wangyongqiang0...@163.com wrote: wangyongqiang0...@163.com

Re: Region Server Info Port

2015-01-21 Thread Dima Spivak
It's not clear to me why it's not showing the right port in pseudo-distributed mode, Talat. Even when getting the value out of the Configuration object it's getting out the wrong one? -Dima On Wed, Jan 21, 2015 at 3:03 PM, Talat Uyarer ta...@uyarer.com wrote: IMHO reaching rs info port

Re: 404 for hbase book

2015-01-14 Thread Dima Spivak
The issues are known and being worked on. :) -Dima On Wed, Jan 14, 2015 at 10:24 AM, Elliott Clark ecl...@apache.org wrote: I'm seeing 404's too. I'm seeing them going to just about anything book related from the front page, not from google. * Go to hbase.apache.org * click on

Re: help- org.apache.hadoop.hbase.RegionTooBusyException: Above memstore limit(hbase and ycsb)

2015-01-13 Thread Dima Spivak
This thread from last year seems to describe the same issue you're seeing: http://apache-hbase.679495.n3.nabble.com/RegionTooBusyException-Above-memstore-limit-td4056339.html All the best, -Dima On Tue, Jan 13, 2015 at 9:30 PM, jackiehbaseu...@126.com jackiehbaseu...@126.com wrote: dear all!

Re: My cdh5.2 cluster get FileNotFoundException when running hbase MR jobs

2014-12-09 Thread Dima Spivak
Dear Ehud, You need the -libjars jar argument to move the dependency on your local file system into HDFS (the error is because that JAR is not there). -Dima On Tue, Dec 9, 2014 at 1:05 AM, Ehud Lev e...@gigya-inc.com wrote: My cdh5.2 cluster has a problem to run hbase MR jobs. For example,

Re: Trying to connect HBase Java Client I get: Failed to locate the winutils binary in the hadoop binary path

2014-11-13 Thread Dima Spivak
Nestor, No, you don't need a full distribution of Hadoop installed on your client machine as long as you have the necessary dependencies on the classpath when you run the client. -Dima On Wed, Nov 12, 2014 at 4:47 PM, Néstor Boscán nesto...@gmail.com wrote: Yes I already applied that. I

Re: Trying to connect HBase Java Client I get: Failed to locate the winutils binary in the hadoop binary path

2014-11-13 Thread Dima Spivak
, Nestor On Thu, Nov 13, 2014 at 4:07 AM, Dima Spivak dspi...@cloudera.com wrote: Nestor, No, you don't need a full distribution of Hadoop installed on your client machine as long as you have the necessary dependencies on the classpath when you run the client. -Dima On Wed, Nov 12

Re: Trying to connect HBase Java Client I get: Failed to locate the winutils binary in the hadoop binary path

2014-11-13 Thread Dima Spivak
it directly in the Java IDE. And the project has all the dependencies from Maven. Regards, Néstor On Thu, Nov 13, 2014 at 7:12 AM, Dima Spivak dspi...@cloudera.com javascript:; wrote: Nestor, You mention building your client with Maven, but how are you running it (i.e. are you sure

Re: Question about hbase's name node

2014-11-08 Thread Dima Spivak
bcc: dev@, cc: user@ On Sat, Nov 8, 2014 at 2:44 AM, mail list louis.hust...@gmail.com wrote: hi all, We are testing the HBase. We shutdown all the name nodes, but we can still put rows into HBase, and the “list” command is blocking. Then we stop and restart all the HBase system,

Re: UI tool

2014-11-05 Thread Dima Spivak
and hadoop 2.2 so can i use Hue? On Thu, Nov 6, 2014 at 10:17 AM, Dima Spivak dspi...@cloudera.com wrote: +user@, bcc: dev@ Check out the Hue project at http://gethue.com/ . All the best, Dima On Wed, Nov 5, 2014 at 8:25 PM, Srikanth Srungarapu srikanth...@gmail.com wrote

Re: It is possible to indicate a specific key range into a specific node?

2014-11-02 Thread Dima Spivak
Hi Yong, Check out http://hbase.apache.org/book/perf.writing.html to learn about pre-splitting regions at table creation time. Beyond this, HBase internally handles which RegionServers serve any particular region. All the best, Dima On Sun, Nov 2, 2014 at 11:32 AM, yonghu

Re: It is possible to indicate a specific key range into a specific node?

2014-11-02 Thread Dima Spivak
Oops, accidentally cut out my last sentence: If you do want to move a region manually, the simplest way to do this is by invoking move in the HBase shell. -Dima On Sun, Nov 2, 2014 at 11:51 AM, Dima Spivak dspi...@cloudera.com wrote: Hi Yong, Check out http://hbase.apache.org/book

Re: Reducing the logging info on Eclipse console

2014-10-29 Thread Dima Spivak
Benjamin, You can reduce the log level with the log4j properties file under hbase-server/src/main/resources. All the best, Dima On Wednesday, October 29, 2014, Sznajder ForMailingList bs4mailingl...@gmail.com wrote: Hi, When running Hbase client from my eclipse IDE, I get a very large

Re: getting into the industry, is theory enough?

2014-10-18 Thread Dima Spivak
Dear S, If you're interested in HBase, you can't go wrong with reading the ref guide (hbase.apache.org/book.html) and checking out open JIRAs ( issues.apache.org/jira/browse/HBASE) waiting for someone to fix them :). Even if you don't want to go into developing the technology itself, there's no

Re: I tried to learn hbase from apache site and Hbase in action. But i am not able to get clarity on hbase. could you please suggest me best way to learn hbase.

2014-09-23 Thread Dima Spivak
Dear Satya, Copying and pasting the Java into the hbase shell won't work since it uses a unique syntax based on JRuby. If you want to run the code you see in Java, the easiest way to do it is to use an IDE like IntelliJ. Create a Maven project with a pom.xml file and include the hbase-client as

Re: Custom Filter on hbase Column

2014-09-11 Thread Dima Spivak
Hi Nishanth, Take a look at http://hbase.apache.org/book/client.filter.html . If I understand your use case correctly, you might want to look at RegexStringComparator to match the first 1000 characters of your column qualifier. -Dima On Thu, Sep 11, 2014 at 12:37 PM, Nishanth S

Re: The default hbase.regionserver.info.port doesn't work

2014-09-04 Thread Dima Spivak
When debugging in the future, try curl -L; it'll follow redirects. -Dima On Thu, Sep 4, 2014 at 3:39 AM, Ted Yu yuzhih...@gmail.com wrote: If you enter this into your browser: http://127.0.0.1:16030/ It would redirect to (64128 may vary on your computer):

Re: Error while HBase from source code

2014-09-03 Thread Dima Spivak
daemons in one JVM. I have not changed any single configuration , i tried to start hbase with all default configuration. Let me know if need info to debug. Regards Sanjiv Singh Mob : +091 9990-447-339 On Tue, Sep 2, 2014 at 1:21 PM, Dima Spivak dspi...@cloudera.com

Re: RE: RE: re: What's the exact procedure of making a custom filter work?

2014-07-17 Thread Dima Spivak
Aleks' jdiff script is jdiffHBasePublicAPI.sh and can be found in the top-level dev-support folder. On Github: https://github.com/apache/hbase/blob/master/dev-support/jdiffHBasePublicAPI.sh -Dima On Wed, Jul 16, 2014 at 7:57 PM, Ted Yu yuzhih...@gmail.com wrote: If I remember correctly,

Re: Simple user based authentication for HBase

2014-07-15 Thread Dima Spivak
Dear Denis, HBase supports user authentication through an RPC-level implementation using SASL. Matteo Bertozzi has a nice blog post up describing this and showing the most common case of Kerberos (though other authentication systems can be used, as well). See:

Re: Using HBase in standalone mode in production

2014-07-07 Thread Dima Spivak
In general, production systems run in distributed mode because they leverage HBase's scalability and reliability; HBase really only shows its worth when it's charged with managing terabytes of data on a fault-tolerant file system like HDFS. You lose both of these when you run in standalone mode,

Re: Using HBase in standalone mode in production

2014-07-07 Thread Dima Spivak
? Thanks, Arun On Jul 7, 2014 6:02 PM, Dima Spivak dspi...@cloudera.com wrote: In general, production systems run in distributed mode because they leverage HBase's scalability and reliability; HBase really only shows its worth when it's charged with managing terabytes of data on a fault

Re: HBase Cluster setup

2014-06-19 Thread Dima Spivak
What does your setup look like? Are you running from the extracted tarball? Any modifications to hbase-site.xml? -Dima On Tuesday, June 17, 2014, prmdbaora pinkpantherp...@gmail.com wrote: ubuntu@namenode:~$ hbase/bin/start-hbase.sh Error: Could not find or load main class

Re: issue about two hbase on same hadoop cluster

2014-06-18 Thread Dima Spivak
ch, Not sure if this is dated, but http://mail-archives.apache.org/mod_mbox/hbase-user/201010.mbox/%3CAANLkTimzn8hWAVhAqga2f=uz4ta22fxwt7qoe3y+m...@mail.gmail.com%3E might be a good place to start. -Dima On Wed, Jun 18, 2014 at 8:10 PM, ch huang justlo...@gmail.com wrote: hi,maillist:

Re: can not modify configuration in hbase shell

2014-06-16 Thread Dima Spivak
Dear ch, This feature was only introduced into HBase starting with version 0.95. The original JIRA can be found here: https://issues.apache.org/jira/browse/HBASE-7236 All the best, Dima On Sun, Jun 15, 2014 at 11:57 PM, ch huang justlo...@gmail.com wrote: hi ,mailist: i try

Re: how to calculate all the number of store file on hbase all table ?

2014-06-16 Thread Dima Spivak
Dear ch, HBase tables are stored in HDFS following a hierarchy that mimics your table's schema. In particular, check out the following section of the ref guide: http://hbase.apache.org/book/trouble.namenode.html#trouble.namenode.hbase.objects . Once you understand that, you can basically just do

Re: Why Custom Filters are more resource exhaustive then normal single column value filter

2014-06-16 Thread Dima Spivak
Hi Vikram, Maybe I'm misunderstanding your question, but isn't this expected since coprocessors do the heavy lifting at the level of the RegionServer whereas the client API means you hit a bottleneck as data is transferred from each RS to your gateway? -Dima On Monday, June 16, 2014, Vikram

Re: No of column qualifiers in a column family

2014-06-15 Thread Dima Spivak
Hi Vimal, There's no limit on how many qualifiers a particular column family can have, nor should there be any performance degradation due to simply having different numbers of qualifiers for different families (unless this leads to huge differences in row numbers between families). For more

Re: Does compression ever improve performance?

2014-06-13 Thread Dima Spivak
I'd highly recommend it. In general, compressing your column families will improve performance by reducing the resources required to get data from disk (even when taking into account the CPU overhead of compressing and decompressing). -Dima On Fri, Jun 13, 2014 at 10:35 AM, jeremy p

Re: can't start hbase in distributed mode in a single machine

2014-06-09 Thread Dima Spivak
Dear Li, Are you managing your own ZK instance or just letting start-hbase.sh handle it? -Dima On Sun, Jun 8, 2014 at 10:17 PM, Li Li fancye...@gmail.com wrote: I run start-hbase.sh and after a few minutes, the HMaster process disappears, but the HQuorumPeer process is ok. I can telnet

Re: HBase 0.96 dependecy

2014-05-22 Thread Dima Spivak
Dear Talat, Have you tried to go up one level in the Central Repository? They still have jars for each module (e.g. hbase-client if you're trying to use the API): http://search.maven.org/#browse%7C359444332 All the best, Dima On Thu, May 22, 2014 at 12:55 AM, Talat Uyarer ta...@uyarer.com

<    1   2