I would assume that if I get a snap shot of dfs I would get hbase with that.
I was going to use it for back of hbase but would like to be able to get a
snapshoot of the whole dfs for back up reasons..
Billy
Jim Kellerman [EMAIL PROTECTED] wrote in
message
news:[EMAIL PROTECTED]
Billy,
Hbase does split on a row key level so what's to happens if I have a row
that's larger then the max region size set in the conf?
I have one row that has been split into many smaller regions I just checking
if it can tell what row goes where.
Little Update for who every works on this issue looks like the .meta. region
get assigned and that server will not get any more regions because it
handling load request for the other servers this might balance out once the
meta table splits and get put on mult servers then each server would
Billy wrote:
Hbase does split on a row key level so what's to happens if I have a row
that's larger then the max region size set in the conf?
My guess is that a row configured region size would not be split.
I have one row that has been split into many smaller regions I just checking
if
Or see http://wiki.apache.org/lucene-hadoop/Hbase/FAQ#1
St.Ack
Peter Boot wrote:
look in src\contrib\hbase\src\test\org\apache\hadoop\hbase\TestHBaseCluster.java
On Dec 18, 2007 7:51 PM, ma qiang [EMAIL PROTECTED] wrote:
Hi colleague,
After reading the API docs about hbase,I don't
This one of the hottest issues for us as well.
Only thing we have been able to think of is running on Solaris+ZFS and
doing coordinated snapshots of the underlying filesystems. Not sure if
even that would work (since the membership of the cluster can change
from the time the snapshot was taken to
Basically I have one row key that has a lot of parent:child cols in it the
parent is the same and the Childs are all different. I been testing the
splits part of the servers so set the region max size to 16MB so it would
split more often. when I can back after a log process had been running I
Basically I have one row key that has a lot of parent:child cols in it the
parent is the same and the Childs are all different. I been testing the
splits part of the servers so set the region max size to 16MB so it would
split more often. when I can back after a log process had been running I had
Hi All:
The aggregation classes in Hadoop use a HashMap to hold unique values in
memory when computing unique counts, etc. I ran into a situation on 32-node
grid (4G memory/node) where a single node runs out of memory within the reduce
phase trying to manage a very large HashMap. This
Have you looked at hadoop.io.MapWritable?
---
Jim Kellerman, Senior Engineer; Powerset
-Original Message-
From: C G [mailto:[EMAIL PROTECTED]
Sent: Wednesday, December 19, 2007 11:59 AM
To: hadoop-user@lucene.apache.org
Subject: HashMap which can spill to disk for Hadoop?
Hi All:
You should also be able get quite a bit of mileage out of special purpose
HashMaps. In general, java generic collections incur large to huge
penalties for certain special cases. If you have one of these special cases
or can put up with one, then you may be able to get 1+ order of magnitude
I¹m interested in driving hbase from PHP or Ruby. I have seen at least two
approaches mentioned and wonder if there are others out there.
* Hbase shell.
* REST interface.
Can anyone let me know if you are using these or some other approach and
where to find any code or docs.
Thanks. I have read this doc and it seems to fit the bill but maybe I
missed where to find the code. Did I miss it in the trunk?
On 12/19/07 3:18 PM, Peter Boot [EMAIL PROTECTED] wrote:
http://wiki.apache.org/lucene-hadoop/Hbase/HbaseShell/PHP
On Dec 19, 2007 3:11 PM, Pat Ferrel [EMAIL
https://issues.apache.org/jira/browse/HADOOP-2171
On Dec 19, 2007 3:48 PM, Pat Ferrel [EMAIL PROTECTED] wrote:
Thanks. I have read this doc and it seems to fit the bill but maybe I
missed where to find the code. Did I miss it in the trunk?
On 12/19/07 3:18 PM, Peter Boot [EMAIL PROTECTED]
I have written several functions that will work with the rest interface
that's working in the current trunk there all complete with all the options
I would like to have working on them but work fine. I can email you a copy
of my function file if you want to.
Billy
Pat Ferrel [EMAIL
if you apply the patch and build the latest trunk the
fileHShellConnect.class.phpis here
src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/client/HShellConnect.class.phpIf
you want to look at the code I have done for hbase and php with the rest
interface let me know they work just not
HADOOOP-2171 is waiting.
It is a low-level sample code.
If your needs can be satisfied or/ want to get started with my solutions,
Please drop the comment.
Then, I'll contribute my source code.
Thanks,
Edward.
--
B. Regards,
Edward yoon @ NHN, corp.
Home :
Edward
Please explain what you mean by
Please drop the comment.
thanks
Peter
On Dec 19, 2007 7:21 PM, edward yoon [EMAIL PROTECTED] wrote:
HADOOOP-2171 is waiting.
It is a low-level sample code.
If your needs can be satisfied or/ want to get started with my solutions,
Please drop the
Demand determines supply.
In other words, i need a supporter for contribute the code to hbase shell.
--
B. Regards,
Edward yoon @ NHN, corp.
Home : http://www.udanax.org
Date: Wed, 19 Dec 2007 19:25:19 -0800
From: [EMAIL PROTECTED]
To:
a supporter to help with some of the programming ? Or support to say
it is sorely needed ? Which it obviously is
On Dec 19, 2007 7:33 PM, edward yoon [EMAIL PROTECTED] wrote:
Demand determines supply.
In other words, i need a supporter for contribute the code to hbase shell.
Internally, HQL - ServerClient modules(PHP extension, ASP dll, C++, C, Simple
Query Analyzer for windows) are already done by my team.
If you like this approach (socket-based), you can click the vote it button.
(Becuase, I'm not a committer)
Then i'll contribute the solutions to my hbase shell
Thanks.
you can add a '+1' as a text using comment.
--
B. Regards,
Edward yoon @ NHN, corp.
Home : http://www.udanax.org
Date: Wed, 19 Dec 2007 20:38:02 -0800
From: [EMAIL PROTECTED]
To: hadoop-user@lucene.apache.org
Subject: Re: HBase + PHP (or Ruby)
I
Sounds like a bug Billy. hbase shouldn't be splitting rows. Please
file a JIRA with how you brought on the condition and evidence of the
split row (You're running TRUNK, right?).
Thanks,
St.Ack
Billy wrote:
Basically I have one row key that has a lot of parent:child cols in it the
parent is
Hi, all,
I am new to Hadoop and figuring out what is the functionality of hadoop-*-
tes.jar. When seeing the src code tree, I saw directories like dfs, io, ipc
and etc. Does it test for all functionalities listed there? And how to use
it for test?
Is there any document that can answer my
Hi All,
Kindly clarify our doubts mentioned below
1.Did Separate machines/nodes needed for Namenode ,Jobtracker, Slavenodes
2. If hadoop is configured in multinode cluster(with One machine as namenode
and jobtracker and other machine as slave. Namenode acts as a slave node
also) . How to
/
STARTUP_MSG: Starting DataNode
STARTUP_MSG: host = slave/172.16.0.58
STARTUP_MSG: args = []
/
2007-12-20 12:38:35,507 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
27 matches
Mail list logo
