Hi,
Thanks! Can we have the customer number as the RowKey for the customer
(client) master table? Please help in educating me on the advantage and
disadvantage of having customer number as the Row key...
Also SCD2 we may need to implement in that table.. will it work if I have
like that?
Or
Hello sir,
You might become a victim of RS hotspotting, since the cutomerIDs will
be sequential(I assume). To keep things simple Hbase puts all the rows with
similar keys to the same RS. But, it becomes a bottleneck in the long run
as all the data keeps on going to the same region.
HTH
Hi Rams,
yes. You can. See follows:
hbase(main):001:0 create 'test1','course'
0 row(s) in 1.6760 seconds
hbase(main):002:0 put 'test1','tom','course',90
0 row(s) in 0.1040 seconds
hbase(main):003:0 scan 'test1'
ROW COLUMN+CELL
tom column=course:,
Just out of curiosity, why would you want to do that? What would you do if
you want to do a quick fetch, say I want the 'username' from a table called
'users'?Moreover, we do not use the shell for any real world use-case and
the API doesn't holds any Put.add() that can be used without the key i.e
Have you changed the line 127.0.1.1 in your /etc/hosts file to
127.0.0.1??
Regards,
Mohammad Tariq
On Mon, Nov 26, 2012 at 3:57 PM, Alok Singh Mahor alokma...@gmail.comwrote:
Hi all,
I want to setup HBase in standalone mode on local filesystem.
I want to use local file system so I
content of my /etc/hosts is
127.0.0.1 localhost
127.0.1.1 alok
# The following lines are desirable for IPv6 capable hosts
::1 ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
do i need to change anything in this?
Change 127.0.1.1 alok to 127.0.0.1 alok.
No, Hadoop and ZK are not required for local Hbase setup. But, I would
recommend at least a pseudo-distributed setup in order to get yourself
familiar with Habse properly.
HTH
Regards,
Mohammad Tariq
On Mon, Nov 26, 2012 at 4:12 PM,
You are welcome Alok :)
Yes, you can set that value through hbase-site.xml file.
You can visit this link, if you need any help :
http://cloudfront.blogspot.in/2012/06/how-to-configure-habse-in-pseudo.html
I have outlined the whole process there.
HTH
Regards,
Mohammad Tariq
On Mon, Nov
Hello Sir ,
For solving RS hotspotting you can also try this below
http://blog.sematext.com/2012/04/09/hbasewd-avoid-regionserver-hotspotting-despite-writing-records-with-sequential-keys/
It works fine ..
Regrading the Columns Family you can also try to group similar columns
towards one family,
Rams,
I think you need to go back and think about why you want to use Hadoop and
HBase in the first place.
Second, you need to think about your data and how you are planning to use it.
Beyond that, we can only give you a bit of generic answers
1) You can create a table with 600
If the row Key is just the customer ID, then a simple MD5 hash or SHA-1 hash
would suffice.
That would clear up any risk of hot spotting, once you do your initial load of
data.
And that's probably a key point... hot spotting when you're first loading a
very large table is really a moot
Hi there, somebody already wisely mentioned the link to the # of CF's
entry, but here are a few other entries that can save you some heartburn
if you read them ahead of time.
http://hbase.apache.org/book.html#datamodel
http://hbase.apache.org/book.html#schema
hi
what's the recommended nodes for NN, hmaster and zk nodes for a larger cluster,
lets say 50-100+
also, what would be the ideal replication factor for larger clusters when u
have 3-4 racks ?
--
David
Hello David,
Do you mean the recommended specs?IMHO, it depends more on the data
and the kind of processing you are going to perform, rather than the size
of your cluster.
Regards,
Mohammad Tariq
On Mon, Nov 26, 2012 at 7:23 PM, David Charle dbchar2...@gmail.com wrote:
hi
what's
Are you asking about hardware recommendations?
Eric Sammer on his Hadoop Operations book, did a great job about this:
For middle size clusters (until 300 nodes):
Processor: A dual quad-core 2.6 Ghz
RAM: 24 GB DDR3
Dual 1 Gb Ethernet NICs
a SAS drive controller
at least two SATA II drives in a
Uhm, those specs are actually now out of date.
If you're running HBase, or want to also run R on top of Hadoop, you will need
to add more memory.
Also forget 1GBe got 10GBe, and w 2 SATA drives, you will be disk i/o bound
way too quickly.
On Nov 26, 2012, at 8:05 AM, Marcos Ortiz
Thanks, but hard-coding the master's IP in my client code doesn't work - I
also don't really understand why it has to be set in the client, as
according to the flow you describe, the client is getting all it needs to
know from zookeeper (?).
Doing some digging on the HBase server side, I found
Yes, it's not useful to set the master address in the client. I suppose it
was different a long time ago, hence there are some traces on different
documentation.
The master references itself in ZooKeeper. So if the master finds itself to
be locahost, ZooKeeper will contain locahost, and the
thank you :)
On Mon, Nov 26, 2012 at 4:28 PM, Mohammad Tariq donta...@gmail.com wrote:
You are welcome Alok :)
Yes, you can set that value through hbase-site.xml file.
You can visit this link, if you need any help :
Setting up a local system HBase is frequently asked in the mailing list :).
Regards
Ram
On Mon, Nov 26, 2012 at 10:01 PM, Alok Singh Mahor alokma...@gmail.comwrote:
thank you :)
On Mon, Nov 26, 2012 at 4:28 PM, Mohammad Tariq donta...@gmail.com
wrote:
You are welcome Alok :)
Yes,
I wouldn't do that unless you're running in a VM. Also don't lose the local
host reference. That's the important one.
On Nov 26, 2012, at 4:46 AM, Mohammad Tariq donta...@gmail.com wrote:
Change 127.0.1.1 alok to 127.0.0.1 alok.
No, Hadoop and ZK are not required for local
What happens if you put up a shell on your hbase instance and do the
same thing? Does it succeed?
St.Ack
On Sun, Nov 25, 2012 at 11:45 PM, shyam kumar lakshyam.sh...@gmail.com wrote:
HI
I am unable to create a Table in hbase dynamically
am using the following code
if
On Mon, Nov 26, 2012 at 7:28 AM, Nicolas Liochon nkey...@gmail.com wrote:
Yes, it's not useful to set the master address in the client. I suppose it
was different a long time ago, hence there are some traces on different
documentation.
The master references itself in ZooKeeper. So if the
Hello Matan,
Did it work?If not, add these properties in your hbase-site.xml file
and see if it works for you.
property
namehbase.zookeeper.quorum/name
valueZH-HOST_MACHINE/value
/property
property
namehbase.zookeeper.property.clientPort/name
On Sun, Nov 25, 2012 at 8:28 AM, matan ma...@cloudaloe.org wrote:
Nothing. Maybe just link to it from
http://hbase.apache.org/book/quickstart.html such that people for whom the
quick start doesn't work, will have a direct route to this and other
prerequisites.
I just added note on loopback
What are your exact 'manager GUI' needs though? I mean, what are you
envisioning it will help you perform (over the functionality already
offered by the HBase Web UI)?
On Mon, Nov 26, 2012 at 9:59 PM, Alok Singh Mahor alokma...@gmail.com wrote:
Hi all,
I have set up standalone Hbase on my
Hi Mohammad,
Your answer was right, just that specifying the master address is not
necessary (anymore I think). But it does no harm.
Changing the /etc/hosts (as you did) is right too.
Lastly, if the cluster is standalone and accessed locally, having localhost
in ZK will not be an issue. However,
I need frontend for HBase shell like we have phpmyadmin for MySql.
I tried 127.0.0.1:600010 and 127.0.0.1:60030 these are just giving
information about master mode and regional server respectively. so I tried
to use hbasemanagergui but i am unable to connect it
does HBase web UI have feature of
I am running HBase 0.94.2 running on 6 servers with Zookeeper 3.4.5 running on
3. HBase works from its shell and from within Eclipse but not as a jar file.
When I run within Eclipse I can see it worked properly by using the HBase shell
commands (such as scan).
I seem to have 2 separate
I am running HBase 0.94.2 running on 6 servers with Zookeeper 3.4.5 running on
3. HBase works from its shell and from within Eclipse but not as a jar file.
When I run within Eclipse I can see it worked properly by using the HBase shell
commands (such as scan).
I seem to have 2 separate
Hello Nicolas,
You are right. It has been deprecated. Thank you for updating my
knowledge base..:)
Regards,
Mohammad Tariq
On Tue, Nov 27, 2012 at 12:17 AM, Nicolas Liochon nkey...@gmail.com wrote:
Hi Mohammad,
Your answer was right, just that specifying the master address is
Hello Alok,
I have seen this project. Good work. But let me tell you one thing, the
way Hbase is used is slightly different from the way you use traditional
relational databases. Rarely people, who are working on real clusters, face
a situation wherein they need to query Hbase directly.
I am running HBase 0.94.2 running on 6 servers with Zookeeper 3.4.5 running on
3. HBase works from its shell and from within Eclipse but not as a jar file.
When I run within Eclipse I can see it worked properly by using the HBase shell
commands (such as scan).
I seem to have 2 separate
On Mon, Nov 26, 2012 at 2:16 PM, Mohit Anchlia mohitanch...@gmail.com wrote:
I have a need to move hbas-site.xml to an external location. So in order to
do that I changed my configuration as shown below. But this doesn't seem to
be working. It picks up the file but I get error, seems like it's
The difference is your classpath.
So -for problem 1, you need to specify jars under /hbase-0.94.2/lib to
your classpath. You only need a subset ... but first to get over the
problem set your classpath with all these jars. I don't think
specifying a wildcard * works ... like below
Thanks! This is the client code I was referring to. The below code doesn't
seem to work. Also I tried HBaseConfiguration.addHBaseResrouce and that
didn't work either. Is there any other way to make it configurable outside
the resource?
On Mon, Nov 26, 2012 at 2:39 PM, Stack st...@duboce.net
thanks a lot Mahammad for this very complete and so mature reply :)
I am very new and just started playing with HBase for my college project
work. I will try to play with API's
thanks :)
On Tue, Nov 27, 2012 at 2:31 AM, Mohammad Tariq donta...@gmail.com wrote:
Hello Alok,
I have seen this
There is no exception or warnings in the log and the console prints the
following
12/11/27 11:03:42 INFO zookeeper.ZooKeeper: Client
environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48 GMT
12/11/27 11:03:42 INFO zookeeper.ZooKeeper: Client
environment:host.name=localhost
38 matches
Mail list logo
