...@cloudera.com]
Sent: Sun 5/16/2010 12:27 AM
To: hbase-user@hadoop.apache.org
Subject: Re: Using HBase on other file systems
On Sat, May 15, 2010 at 1:19 PM, Gibbon, Robert, VF-Group
robert.gib...@vodafone.com wrote:
Todd thanks for replying. 4x 7200 spindles and no RAID = approx 360 IOPS
@hadoop.apache.org
Subject: Re: Using HBase on other file systems
On Fri, May 14, 2010 at 2:15 PM, Gibbon, Robert, VF-Group
robert.gib...@vodafone.com wrote:
Hmm. What level of IOPs does Hbase need in order to support a reasonably
responsive level of service? How much latency in transfer times
®erred
Sent via BlackBerry from T-Mobile
-Original Message-
From: Gibbon, Robert, VF-Group robert.gib...@vodafone.com
Date: Sat, 15 May 2010 22:19:57
To: hbase-user@hadoop.apache.org
Subject: RE: Using HBase on other file systems
Todd thanks for replying. 4x 7200 spindles and no RAID
No, Todd was not specifying some kind of minimum. The point was the more
spindles, the better for an I/O parallel architecture like HDFS and BigTable.
Have you read the BigTable paper?
- Andy
From: Gibbon, Robert, VF-Group
Subject: RE: Using HBase on other file systems
Todd thanks
-Original Message-
From: Todd Lipcon [mailto:t...@cloudera.com]
Sent: Sat 5/15/2010 3:51 AM
To: hbase-user@hadoop.apache.org
Subject: Re: Using HBase on other file systems
On Fri, May 14, 2010 at 2:15 PM, Gibbon, Robert, VF-Group
robert.gib...@vodafone.com wrote:
Hmm. What level
...@apache.org]
Sent: Thu 5/13/2010 11:54 PM
To: hbase-user@hadoop.apache.org
Subject: RE: Using HBase on other file systems
You really want to run HBase backed by Eucalyptus' Walrus? What do you have
behind that?
From: Gibbon, Robert, VF-Group
Subject: RE: Using HBase on other file systems
[...]
NB. I
,ufs, myriad other
single-node filesystems that exist.
-Todd
-Original Message-
From: Andrew Purtell [mailto:apurt...@apache.org]
Sent: Thu 5/13/2010 11:54 PM
To: hbase-user@hadoop.apache.org
Subject: RE: Using HBase on other file systems
You really want to run HBase backed
systems
You really want to run HBase backed by Eucalyptus' Walrus? What do you
have
behind that?
From: Gibbon, Robert, VF-Group
Subject: RE: Using HBase on other file systems
[...]
NB. I checked out running HBase over Walrus (an AWS S3
clone): bork - you want me to file a Jira
bricks to get I/O locality, yet there is no way for Gluster
to
export stripe locations back to Hadoop.
It seems a poor choice.
- Andy
From: Edward Capriolo
Subject: Re: Using HBase on other file systems
To: hbase-user@hadoop.apache.org hbase-user@hadoop.apache.org
as pointed out in another mail, you'll want to colocate
TaskTrackers
on Gluster bricks to get I/O locality, yet there is no way for Gluster
to
export stripe locations back to Hadoop.
It seems a poor choice.
- Andy
From: Edward Capriolo
Subject: Re: Using HBase on other file
To: hbase-user@hadoop.apache.org
Subject: Re: Using HBase on other file systems
Hey,
I think one of the key features of HDFS is its ability to be run on
standard hardware and integrate nicely in a standardized datacenter
environment. I never would have got my project off the ground if I
had
You really want to run HBase backed by Eucalyptus' Walrus? What do you have
behind that?
From: Gibbon, Robert, VF-Group
Subject: RE: Using HBase on other file systems
[...]
NB. I checked out running HBase over Walrus (an AWS S3
clone): bork - you want me to file a Jira on that?
On Tuesday, May 11, 2010, Jeff Hammerbacher ham...@cloudera.com wrote:
Hey Edward,
I do think that if you compare GoogleFS to HDFS, GFS looks more full
featured.
What features are you missing? Multi-writer append was explicitly called out
by Sean Quinlan as a bad idea, and rolled back.
there is no way for Gluster to
export stripe locations back to Hadoop.
It seems a poor choice.
- Andy
From: Edward Capriolo
Subject: Re: Using HBase on other file systems
To: hbase-user@hadoop.apache.org hbase-user@hadoop.apache.org
Date: Wednesday, May 12, 2010, 6:38 AM
On Tuesday, May
to Hadoop.
It seems a poor choice.
- Andy
From: Edward Capriolo
Subject: Re: Using HBase on other file systems
To: hbase-user@hadoop.apache.org hbase-user@hadoop.apache.org
Date: Wednesday, May 12, 2010, 6:38 AM
On Tuesday, May 11, 2010, Jeff
Hammerbacher ham...@cloudera.com
) to compete.
Certainly
that would improve its scalability and availability story, both issues
today
presenting barriers to adoption, and barriers for anything layered on
top,
like HBase.
- Andy
From: Kevin Apte
Subject: Using HBase on other file systems
To: hbase-user
on other file systems
To: hbase-user@hadoop.apache.org
Date: Sunday, May 9, 2010, 5:08 AM
I am wondering if anyone has thought
about using HBase on other file systems like Gluster. I
think Gluster may offer much faster performance without
exorbitant cost. With Gluster
.
- Andy
From: Kevin Apte
Subject: Using HBase on other file systems
To: hbase-user@hadoop.apache.org
Date: Sunday, May 9, 2010, 5:08 AM
I am wondering if anyone has thought
about using HBase on other file systems like Gluster. I
think Gluster may offer
Hey Edward,
I do think that if you compare GoogleFS to HDFS, GFS looks more full
featured.
What features are you missing? Multi-writer append was explicitly called out
by Sean Quinlan as a bad idea, and rolled back. From internal conversations
with Google engineers, erasure coding of blocks
: Tuesday, May 11, 2010 3:29 PM
To: hbase-user@hadoop.apache.org
Subject: Re: Using HBase on other file systems
Hey Edward,
I do think that if you compare GoogleFS to HDFS, GFS looks more full
featured.
What features are you missing? Multi-writer append was explicitly called out
by Sean Quinlan
]
Sent: Tuesday, May 11, 2010 3:29 PM
To: hbase-user@hadoop.apache.org
Subject: Re: Using HBase on other file systems
Hey Edward,
I do think that if you compare GoogleFS to HDFS, GFS looks more full
featured.
What features are you missing? Multi-writer append was explicitly called
out
I am wondering if anyone has thought about using HBase on other file systems
like Gluster. I think Gluster may offer much faster performance without
exorbitant cost. With Gluster, you would have to fetch the data from the
Storage Bricks and process it in your own environment. This allows
on top, like
HBase.
- Andy
From: Kevin Apte
Subject: Using HBase on other file systems
To: hbase-user@hadoop.apache.org
Date: Sunday, May 9, 2010, 5:08 AM
I am wondering if anyone has thought
about using HBase on other file systems like Gluster. I
think Gluster may offer much
layered on top,
like HBase.
- Andy
From: Kevin Apte
Subject: Using HBase on other file systems
To: hbase-user@hadoop.apache.org
Date: Sunday, May 9, 2010, 5:08 AM
I am wondering if anyone has thought
about using HBase on other file systems like Gluster. I
think Gluster may offer
or you'll need to
extend the FileSystem class to write a client that Hadoop
Core can use.
There is one:
https://issues.apache.org/jira/browse/HADOOP-6253
It even exports stripe locations in a way useful for distributing MR task
placement, but provides only one host per block.
- Andy
25 matches
Mail list logo
